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INTRODUCTION 



^ A comprehensive ^review and evaluation of the Langley Research Center's 
scientific and tec^^cal information (STI) program was conducted, The purpose 
of the review and evaluation was to determine the extient to which the program 
Was meeting the needs of th6 Lanigley research persorinelT and the recipients of 
Langley-generated STI, the areas' of ' the program which needed improvement, and 
the ways in which the program co|ild he modified to improve its overall effi- 
ciency and effeativeness. The goal of the review 'and evaluation project was to 
determine if the dissemination of the Center's research output could be made 
more effective. 

4 

The project utilized both survey research and systems analysis techniques. 
A -steering commi-J^e sjomposed of, one representative from each research division 
wSs^s^ised to deve^lop the objectives and guide the project through its completion. 
The indl^diiar tasks required to accbmplish the objectives were established 
and were' included as^p^ases in the project plan whi^h is Appendix A of this 
report. The results of^h^ase IV - Knowledge and Attitudes Survey, Academic 
and Industrial Personnel are contained in this report. 

^ STATEMENT OF, THE.-EROBLEIM 



iDurihg the^-year history of the Langley Research Center, a comprehensive 
review and evaluat±ofv^^of^the Center's STI program had never been conducted. . 
Portions of the Larigley S^ program had received periodic or occasional assess- 
ment; howevfer, no valid empirical data existed which could be used to evaluate' 
the overall program. 

• - • ' ■ r 

Purpose of the Study 

The purpose of Phase IV was. to determine the-knowledge-of and attitudes 
toward *Langley and NASA scientific dnd technical information (STI) held by the 
external 'user population. Phase IV utilized sxirvey research to assess the 
u6age,. importance, and perceived j^uality of NASA Langley-generated STI and 
the familiarity with and use of selected NASA pdi>lications and services and to 
determine ways in which Langley-generated STI could be made more accessible to 
external users. - - - 



1 



r .Objeatives. of- >the> Study 

Seven objectives were es^ablishl'a^'fdr 1*Jiase IV • These objectives were to 

1. Assess the familiarity with and frequency of use of sele6tecL-NAS^;^TI 
publications apd services; 

2. Assess, the impoftahce of NASA STI and Langley^authored (published) STI 
in terms of "advancing the state-of-the-art"; 

3. Detennine the frequency of ordering and the relative speed of delivery 
for NASA technical reports; ^ v 

4. Detennine the use of non~NASA, NASA-authored, and Latigley-authored 
(published) STI; " , , 

5. Gather' data as to the technical quality, the adequacy of data, the 

organization (format) , and the quality of visual presentation to detennine the 

perceived image of Laogley-authored (published) STI; 

* . • " 

6» Ascertain specif ic demographic information such' as wo^ experience, 
type of research organization, professional- duties, major field of interest, 
and ptabli cation activities about the survey participants; and 

t?} ^dentify ways in which Langley-generated S'yi could be made more 
accessible to non-NASA engineers and scientists. p 

Setting for the Study ^ 

The Langley Research Center '(LaRC) is one of the leading national labora- 
tories for research and development in the sciences of aeronautics and space 
technoiogy. Founded in 1917, Langley was the -nucleus for the former National 
Advisory Committee for Aeronautics (flACA) . For more' than 60 years, Langley ^ 
engineers and scientists have\ conducted basic and applied research in fluid and 
flight mecha^ics^ flight systems, structures and materials, acoustics and noise 
reductioA, measurernints and instrumentation systems, data systems, and space 
and Earth sciences. For calendar year 1980, Langley's 1,306 engineers and 
scientists produced 1127 items which 3,ncluded 175 NASA formal series technical 
publications, 136 NASA Quick-Release Technical Memorandums, 146 journal^ articles, 
352 conference/meeting papers, 85 NASA Tech Briefs, 10 NASA conputer programs, 
20 patents, and 203 pieces of unpublished research. The documented research 
output of the Langley Research Center is processed through the Langley 
Research Information and Applications Division (RIAD) , Which is an 
integral part of the NASA Scientific and Technical Information system. 



Importance of the Study 

An- e^FSmStion of the .Langley STI program which Included a survey of 

recipients/users in academla aixd Industry had ftever been cconducted. ' xHe 

feedback obtained from the completed questionnaire provided an assessment of 
''^?i-^_f"*^.NASA STI- products and outputs, established a baseline for future 
/evaluative ■ . ef'fdfts;>and Identified ways to increase the accessibility of 

Langley STI. The questionnaire* could be re-administered as part of an 

ori-golng evaluation of the Langley ST-I program. 

■ - i ' ■ ' ' • ■ 

Scope of the Study , - 

The studyjwas limited to (1^ the sdientific ^nd technical information out- 
put of the Langley Research Center as processed through the Langley STI program; 
(2) selected NASA STI publications and services; (3) books, periodicals, 
and research 'specifically concerned with scientific and technical information; 
(4) studies specifically concerned with the Langley STI program and the NASA 
STI sy8teii>» and (5) completed questionnaires received from the survey ^populatioii. 
The survey population consisted, of academic 'and industrial engineers and ' . 
scientists. The study spanned the period from pecember 1980 to February. f 981 . 

GLOSSARY 



lAA International Aerosp^c* Abstracts 
LaRC I^angley Research Center » 

LSTAR Limited Sclent^^-c and Technical Aerospace Reports . 
n Sample Size « 

-NA^___JIational Advisory Committee for Aeronautics 



JlAS^k national Aeronautlcs-andl Spaae-Administra tlon 



NTIS ' National Technical Information Service, 

0MB Office of Management, and Budget / 

RECON Remote Console^ 

RIAD Research Information^ and Applications Division 

^CAN Selected Current Aerospace Net ices 

STAR ^ Scientific and Technical Aerospace Reports 

STI # Scientific and Technical Information 

SP ; Special Publication 



RELATED RESEARCH AND LITERATURE^ . ^ 

?he review of related research. and litera't;ure. emphasized that periodic 
evaluation was essential to the management of information systens. When properly 
conducted, evaluation disclosed the strengths and weaknesses of the system, 
suggested ways to improve the pverall performance of the system, and ultimately 
improved, the efficiency and effectiveness of the system (King and Bryant, 1971). 
The literature emphasized that tlie total evaluation of an information 
system encompassed all tlje program objectives and employed a variety of manage- 
ment tools and techniques (Swanson, 1975) . It was established that the infor- 
mation needs of the user were, a necessary dimension in the evaluation process. 
(Debons and Montgomety, 1974). ^ , » 

* EVALUATION OF THE NASA STI SYSTEM . * ' ^ 

\ 

^^nce its inception, various aspects of the NASA STI system were evaluated. 
Bo4:h programmatic and user oriented studies were conducted. , The program- 

matic studies were ''concerned with funding levels, manpower authorization, and 
the location of the STI ^function within the NASA organization (Duberg, 1973) . 
The^user studies sought to determine the effectiveness of the NASrf STI system 
by obtaining feedback from the u^er population. The first Agency-wide user 
study of. the NASA STr system occurred in 1973. Sinbe 1973, a series of user 
studies have been conducted. These studies were reviewed and summarized. 

The Drobka Study , » 

In 1973, the first Agency-wide evaluation, of the NASA STI program was 
undertaken by'F. George Drobka, then Head of the Acquisitions and Dissemination 
54_Branch, 'Headquarters STI office. The study utilized the technique of struc- 
tipred interviews with a representative sample of users. From a population of 
1 114 mid-lev4l engineers and scientists at 10 NASA centers and prime contractor 

\ facilities, an assessment of the usefulness of NASA STI products and services 

Mr 

; i was obtained and recommendations for making the system more effective were' 
\ i established. • ^ ' ' 

\ M 



- The NASA STl system was perceived as the best single soured for needed 
aerospace* information. The majority of researchers used the announcement media 
STAR (67%), lAA (56%)', , SCAN (51%), and RECON (52%). Nevertheless, the respon- 
'dents displayed "fragmentary knowledge of (1) t^ie scope arid^ coverage of our 
system and (2) our document distribution mechanism" (Pfyor, 1975) . 

Action was taken by NASA to satisfy other users needs and improve the 
system: STAR coverage of on-going projects was provided; the subject-category 
schemes for the announcement media were 'revised and expanded; access to addi- 
tional data bases was supplied; quicker RECON response was accbmplished; LSTAR, 
quarterly journal, of security classified and administratively limited documents 
^s initiated; and a copy jaf PROFILES , a publication describing all NASA pro- 
ducts and services, was offered to each scientist and engineer (Vrypr, 1976)^ 

The Burr Study ^ . 

In 1978, a second Agency-wid^e evaluation of the NASA STr^fogram was under- 
taken by Dr. Richard E. Burr, then a Federal Faculty Fellpw^assigned to the f 
NASA Headquarters STl" Branbh, As with the Drobka study, Burr's methodology 
utilised struc1:ured interviews. Interviewees irjcluded 76 scientists and ° 
enViiieers at seven#NASA ce/ters. 

^ ^ The Burr study, as did the Drobka sjfe<idy, exhibdte'd the evaluation objec 
tives connected with the second type sK. user " study described by King an<| Bryant 
(1971). Like the Drobka study, th^urr study (1978) assessed the ^usefulness 
of the STI system in meeting the/lsers' needs, elicited ways iA which the 
^ystem could be improved, and documented user awareness of the scop^ and 
coverage of the, NASA. STI prMucts and services. In-depth evaluation of the 
NASA STI products and ser^css was obtained, ihcluding ease of use, purpose of 
use, and adequacy announcement abstracts and categories. An evaluation of 
the ac^isition and dissemination activities was established and an assessment 
of the "Changes installed after the Drobka study was documented. 

Most respondents (82%) indicated that the NASA STI system generally met 
their need&. Almost 80 percent considered the media and services easy to use, 
and at least 85 percent considered the- announcement abstracts adequate. Levels 
of 'system. utilization increased for RECON to 79 percent, 27 percent above 
levels recorded in the Drobka study. The use of three major media', however. 



declinefl from the 1973-1974 levels. STAR use declined from 67 perce/iV to 45 
percent, lAA use from 56 peijcen* to 34 percent7- and SCAN use from 51 percent 
to 45 percent. Half the respondents did not thinlpthat they were made aware 
of all the NASA publications and products which might be Applicable td thedr 
work. Almost- two-thirds (62%) .stated that it woul<3 be useful Tor their instal- 
latioDL to conduct training programs on NASA products and services. The major- 
ity rated the system's acquisition and dissemination activities as good or 
excellent. Reaction to the changes inst^itedafter the Drooka study was less 
poliitive. Assessment of the raised subject categories was very mixed. On 
the average, only 43 percent of the respondents recognized PROFILES , the 
pubiiccTtion which descrdb§^ the produG?ts and services. Familiarity with and 
use of the LSTAR was almost nonexistent. • 

the'Monge Study . ^ ^, 

In 1978, the Ames Research Center contMracted with Communimetrics , Inc. 
ta undertake an evaluation of NASA STI from the viewpoint of non-NASA users in 
the aerdnautical industry. Monge ,(1979) based^ The Assessment of NASA Technical 
Infotmation on data obtained from 450 employees in 40 of the 49 major aero- 
nautical companies. Three methods of ofitaining information were used: a 
questipnnaire containing open- and closed-ended questions, structured inter- 
views, and a multidimensional *scaling bechnique. Data were obtained in these 
major areas: the. efficiency and timeliness of the dissemination process; the/ 
method through which the j:esp<mdent became aware of NASA STI; utilization of 
NASA STI; usage of a specific announcement medium, STAR; a. comparison of 
documents published by NACA and NASA; suggested improvements in' NASA STI; ania 

' the injage of NASA ^TI. ^ . . , / 

Three groups of users were identified and queried dliring the Monge stuAy: 
librarians, executives, an<3 researchers. The Monge study established, that j 
industry corporate libraries wene a criticai link"-\n the disseminatioi of^ 
NASA STI. The largest group of users . learned about NASA docTmehts through 
libr.^ry publications (30%) . Documents on automatic distribution were riot • 

'received 20 percent of the time. ^ It was ^recommended that a manual on prdering 
and distribution processes be distributed to all aeronautical industry ^ 
librari'ans. - - \ , 
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Fot executifves and researchejrjs, NASA was .the second most imporiant source 
of-technicai information (after tec>^nical journals) . JBxecutives used NASA 
documents 27 times per year. • Researchers used NASA documents 32 times per year 
and read NASA-authored journal articles 17 tfimes,per year. ^Seventy-one percent 
said that STAR reports were important or v^ry important in maintaining current 
awareness. jCurrent .awareness was clearly th'fe most significant use fo/ STAR 
reports. Citation of STAR reports was low for in-house publication, (26%) , 
and in other technical publications (10%) A comparison of NACA and 'NASA 
documents vas obtained from, executives, 90 percent of whom had direct experi- 
ence with NACA. Criticism of NASA STI reflected, in part, a desire for d 
return to the comprehensive and exhaustive publications which NACA 'h5d produced 
when the organizatioVi's sole focus was aeronautical problems. The, two major 
inadequacies of , STI content were identified as the failire to relate the* 
research to existing knowledge and to include complete^ata and information in 
reports. It was recommended, that related research sections be included in . 
each reporf and that state-of-the-art publications be produced periodically 
by NASA in major aeronautica-l subjTects. It was also recommended that the . 
organization of reports \be modified to highlight key information in 'the 
abstracts, the summaries, and in the reports themselves. The results of »tHe 
multidimensional scaling technique suggested .strategies for mo<ring the image 
of NASA STI closer to the job ^concepts of aeronautical researchers. To extend 
awareness and use of NASA STI, was i/ecomhended that a brochure presenting - 
the NASA system in 'the terms and . concepts most important, to users should' be 
airculat(^- Ifhroughout the aeronautical industry. . 




EVALUATIM OF THE ^iANGLEY STI PROGRAM 



The Ldngley Research Center STI program is an integiral part of the Agency* s 
STI system and is responsible for implementing Agency and Center ^licies con- 
cerning the ^management of STI. Expeditious publication o£^ the .Cento's research 
output. Is Langley's.pontribution tp the Agency's goal of timely dissemination of 
NASA research. The documented research output of the Center is processed , 
through the tangley Research Information and Applications Division (RIAD) 
In addition, the Publications Branch of RIAD provides in house printing for ' , 
NASA Headquarters, Scientific and Technical. Information Branch. 



This service is provided for the entirje Agency and involves the publicati^pn, 
and clissemination* of NASA's formal series technical publications.* 5, 

Since 1970, a series of aiajJits and -studies were conducted for portions of 
^the tangley s"^ program. The audits and studies were programmatic in nature 
^nd were concerned with ,cost effectiveness. With the exception of ^r^ evaluation 
of the Langley Technical Library (Dewhirst, .1970) , ho attem{>t had been made to 
determine the effectiveness of the Langley STI progr^ qx portions of the pro- 
gram by obtaining feedjjfick from the user population.^ ' ^ * 

In February 1980, a comprehensive review and evaluation ^of the Langley Stl 

/rogram was undertaken. Phase I of the revie^ and evaluation project (Pinelli, 
et. al., 1980) represented the first attempt to obtain feedback from Langley 
engineers and scientists, the internal user population. A study designed to , 
solicit /eedback from academic and industrial engineers and scientists, the 
external population, had not been conducted. 

RESEA^H METHODOLOGY AND -PROCEDURE 

The study utilized^ ^rvey research to obtain feedback from academic and 

• o ' A > * . . ^ #- 

industrial engineers and scientists. The study was conducted in conjunction 
with Continental Research Company. Professional 'research assistance was, 
utilized to establish ^nd enflh^re objectivity and confidentiality, to maintain 
^the integrity of the study, and to; obtain research skills not readily avail- 
^le to the lyroject. ^ ^ 

• - • 

Research Methodology * 

,J^ie methodology fqr the survey portion of the stuky involved the use of 
non-prbbability, techniques (Kress, 1979). (For a discussion of this concept, 
see WentZte'1972, and Bellenger and Greenberg, 1978.) The use of 'iion-probabllity 
-tecljji^tques were chosen because the size and membership of the universe were' 
npt )known (Boyd, Westfall,» and* Stasch, 1977). Further justification 
fox employing non-probability techniques existed because of the ^dministra- 
CiVe difficulty/cost involved in Identifying the universe (Warwick and * 
Linlnger, 1975). , * ^ 
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A sample based on the NASA" distribution llst-for formal repords was not used 
because the distribution was comp&sed of organizations and Institutions rather 
• than Individual users. The sample population was therefore based on the names 
of active researchers furnished by members- of the steering committee. 

Research Procedure ' , ' • 

~ ■ I, . ^ " 

Stage 1' of a four-stage survey procedure involved the development of the 
. sampling '?rame ; , M^ODers of the review and evaluation steering cominittee were 
asked to obtain a list of industrial and academic professionals active in their 
research field from engineers and scientists within their respective divisions. " 
Names, addresses, -and phone *numbei:s were requested for each individual. The 
'compiled lists, representing all the areas in which Langley conducted research, • 
were forwarded to STIPD. Approximately 1,200 names were submitted, 'of which 
less than 2, percent had been or were contractors or grantees. ! 

Stagie .2 of the research procedures involved the vor if i cation of the sample 
frame addresses. From approximately 1,200 submittal^, duplicate names and 
those with inadequate addresses wefre deleted. Addresses and telephone numbers'/ 
extensions were checked for the remaining academic professionals . . The addresses 
and telephone numbers/extens-ions were 'checked for the industrial professionals. 
Those professionals who' were no longer employed by the organization/inst^-tution • 
and Cdt whom ijo current address could be obtained were deleted. Approximately 
600 of the addres^s were verified. . • . * 

"Stage 3 involved the construction of ^he survey questionnaire, ^^lurvey 
questionnaire contained 35 closed-ended questions and three open-ended items, 
^he open-ended items were listed on a separate sheet and- were included as a 
supplement to the- questionnaire. The closed-ended questions employed four and 
five-point attitude Scales (Pis^hbein and Ajzen, 1975). The survey was de'signed 
to assess the usage, importande, and perceived quality of NAgA Langley-generabed 
STI and the use of selected NASA STI publications and services. The question- 
naire was prepared jointly by Continental Research and the project director's 
team. Each question on the survey was pretested on representative members of 
,the sample, -reviewed by members of the project's steering committee, and revised 
by Continental Research. The questions wer^ designed to measure the respondents' 
knowledge of and" attitudes toward Langley and NASA STI; to assess thfe usage, 
importance, and perceived quality of NASA Langley-generated STI; and to determine 
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their' familiarity with and use of related NASA publications and services. In 
addition, demographic dharacteristlcs were obtained. The final survey Instru- 
Qent» 'including the open-ended supplement, is contained In Appendix B. ^ 

Stage 4 involved the conduct of the survey. This stage involved a four- 
step method combining the personal touch of telephone interviews with the depth 
of information possible in a mail survey (Dillman, 1978) 

Step 1 - Each person from the sample frame of 6il usable names was 
telephoned during the week beginning^ November 30^ 1980. Each individual was 
asked to participate in the evaluation project by completing a mail question-s 
naire. The results of these calls were as follows: 
81.3% - willing to participate 
10.8% out of town 

5.6% - nev^r i/e.ached (after many tries) • ^ 
♦2.3% unwilling to participate 
^ Step 2 - Each of the 497 persons who agreed to participate was mailed 
^a questidnnaire within 24 hours"] .The questlonhalre, which was sent with a 
cover letter signed by the president of Continental Research, contained fi brief 
message thanking the individual for his/her participation. (Appendix C.) 

Ste^ 3 - Of the 497 potential respondents who were mailed question- 
naires, 471 received a follow-up phone^call during the week beginning 
December 7, 1980^ This call served as a /reminder to those who had forgotten 
about the survey. and as a thank you call to those who had returned their 
surveys. The balance of those people who were not reached by phone were sent 
letters of appreciation (Appendix D). 

Step 4 - The surveys were returned by mail . The cut-off date for 
inclusion in the' computerized analysis^.yas January 1,1981. Over 80 percent 
of those who were -sent surveys returned theift in time, A total of 381 usable 
surveys were included in the computer analysis. As of January 28, 1981/ 421 
had been returned, making the. final response rate 85 percent. 
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The 381 quest ioi;inaires that were returned by the deadline were thor- 
oughly edited and computer 'coded. Computer tabulations wer^erformed and the 
responses were suiranarized. Appendix E shows the aggregated tallies of these 
questiotinairesi^ Appendix . F displays these tallies calculated without the 
^ "don't know"f. responses. " 

PRESENTATION OF THE DATA 

The responses to^the closed-ended and open-ended questions were presented 
for each survey topic. One hund;:ed sixty res^ponses were received to the open- 
pndfed questions. The results were compilec^^and wepe included according to the 
survey topic to which they applied. 

The number of responses to each question is provided. The numbers (n) 
^ pantain^d in each table represent absolute percentages based^^the survey 

population (n = 381) rather than the n for a .given question. For discussion^ 
purposes, the headings "usually" and "sometimes" were combined; as were the 
" headings "very" and "someiirtiat*!' . 

Survey Topic 1 ; Asse ss the Familiarity With and Use of Select ed NASA STI 
Public^ions and Services ? ' ^ 

Academic and industrial personnel were asked/to respond to three questidtls 
which pertained to familiarity with and use of selected NASA STI. publications 
and services. Questions pertinent to' each topic were^presented and analyzed 
separately. ^ ' - . • 

^apiliarjjty Wi^^^elected *NASA STI Publication.c. . I^o questions were used 
• t6 determine the familiarity with NASA STI publications. The results were sum- 
marized and. are. presented in Table A. ^ ^* 

* ^ TABLE A 

Summary: Subscription/Receipt of Selected 
NASA STI Publications 

^ - PERpEKTAGES " ^ 

«^ your institution or organization subscribe to or deceive NASA 

technical reports? 

Q^'^ , 5.5 no '41.5 . don't ktiow n - 381 

^ \ * 
Does your : :.citution or organization subscribe to or receive such 

NASA aniioVncement laed' . >d abstracting tools as Scientific and 

Technical Aerospace R -.g (STAR) and International Aerospace 
Abstracts (lAA)? 

STAR 6Q:A, yes 12,1 no 27.6 don't know n - 381 

lAA ^AAJJwes ^ > 15.5 no AO, A don't know n 381 

• 11 
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Nearly 83 percent of the respondents indicated that their institution or organ- 
ization subscribed to or received NASA technical reports. Sixty and 44 percent 
respectively, indicated that their institution or/organization subscribed to 
STAR and lAA. .Approximately 28 and 40 percent, /espectively , did not know if 
their institution, or organization received-. STAR And IAA\ 

Several respondents to the open-ended questions indicated that STAR and 
lAA were not cost effective for a small R&D organization*^ Receipt of the»qu6s- 
tionnaire prompted several recipients to check their library or information 
center to ascertain receipt of STAR and lAA. ' ^ 



' Familiarity WjLth and Use of Selected NASA STI Publications and Services . 
A four part question was used to determine familiarity with and use of selected 
NASA STI publications and services. The results were summarized and are pre- 
sented in Table B. 

tABLE B ' 

^ Sfitmoar);^ Familiarity With and Use of Selected 

NASA STI Products and Services 

V " PERCENTAGES 

For my research, I 'use: (check appropriate boxes) 



^ 



Always Usually Sometimes Never ""^^millar with - 

N/A • no answer 



a. STAR (Scientific and 
Technical Aerospace 
Reports), the NASA 
announcement Journal 
for report literature 

b. lAA (International 
Aerospace Abstract), 
the NASA announcement 
Journal for periodi- 
cals, meeting papers, 
and conference 
proceedings 



□ 

11.5 



□ 



5.0 



□ 

18.6 



□ 

10.0 



P 

35.2 



□ 



7.9 



■□ 

26.8 



n - 381 



□ • □ 

32.8 10.5 



SCAN (Selected Current r — r j 1 

Aerospace Notices), a ^ [ | | | 

NASA current awareness 
publication 



4.5 



8.4 



d. NASA literature 
searches obtained 
through thfe NASA Sci- 
entific and Technical 
Information Facility, 
NASA libraries. 
Defense Technical 
Information Center, 
or Department of 
Energy 



NASA SP-7037 "Aeronau- | I 
Con- I 1 



□ □ 



6.0 



tical Engineering Con- 
tinuing Bibliography" 



1.6 



11.0 



□ 

4.2 



□ 

18.6 



□ 

34.9 



□ 

10.8 



□ 



14.7 



□ 

41.7 



53.8 



□ X- □ 



18.9 



□ 

19.9 



29.1 



□ 

63.5 



381 

'3ftl 

* t 

381 



381 
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Approximately 12 percent of, th& respondents "always" used STAR, while approxi- 
mately 54 percent "usually" or ''sometimes" used STAR. Approximately 35 percent 
of the respondents "never" used or were "unfamiliar with" STAR. ^ Approximately 
5 percent of the respondents "always" used lAA, While percent of the respon- 
dents "usually" or "sometime^" used lAA. Approximately 42 percent of the respon- 
dents were "unfamiliar with". lAA. Approximately 6 percent of the respondents 

• "always" used NASA literature searches, while approximately 46 percent "usually" 
or "sometimes" used NASA literature searches. "Unfamiliar with" responses, 64 
and 54 percent, respectively, were recorded for NASA SP-7037 and SCAN. 

_ SeVfetal respondents' indicated reliance upon their library or information 
center for thft gathering of research information. Consequently, they had no 
way of knowing which, if any, NASA STI publication or service had been used. 
Several respondents commented that the selected STI publications, particularly 
the Continuing Bibliographies, should be better publicized. Some respondents 

, Reported difficulty in obtaining their org.anization's copy of STAR. Some re- 
spondents stated that STAR was a valuable tool, while others indicated that STAR s 
was -too voluminous to use efficiently. 

^"""y^r ^' ^^^^^^ '^^^ Importance of NASA STI and Langlev-Authore d 
(Published) STI in Tenp of "Advancirift- the State-of-the-Art" 

Academic and industrial personnel were asked to, respond to three -questions 
which pertpined to the imppr^ance of NASA and Langley-auth^ed (published) STI ' 
in terms of ."advancing the state-of-the-art." ' The results were summarized and 
are presented in Table C. • " , • 

' ~ _ TABLE C , ' " .. . . ' ■ f^' 

I ■ Summary: Importance of HASA STI and 

Langley-Authored (Published) STI < ' 



PERCEHTAjfES 
\ 



For my research,' NASA scl- " I I | I I 1 I 1 | 1 

^ntlflc and technical livfor- inpo^tant | — J | — | | | |_J | | unlmpo 

A3. 6 28.6 14.7 '5.5 3.7 



nation Is 



In terns of "advancing 'the 
.« t a t of - 1 h€(>-a r t , * NASA 
scientific and technical 
Information Is 



In terms of "advancing the 
state-of-the-art," Langley- 
authorcd sclent^lc and 
technical Infor^^TMi- 



^ 3.9 N/A (no answer) n ■ 381 

Important □{□□□□ unimportant 
43.0 37.0 11.3 2.6 1.8 

4.2 N/A (no answer) n - 365 

Important D O D [Z] Cj unimportant 
^ 22.8 32.5 26.8' 2.6 ' 1.0 



1^*2 not familiar vlth those 
^6bi Langley 



381 
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Approximately 72 percent of the respondents indicated that> NASA STl was '"very" 
or "somewhat" important for their researi^h. Approximately 80 percent indicated 
that NASA STl was ^'very" or '^somewhat" important for "advancing the state-of- 
the art." Nearly 56 percent of the respondents perceived Langley STl as being 
"very" or "somewhat" important for "advancing the state-of-the-art." 

Several respondents- tp -the .open-ended questions^ommented that all N^A 
centers conducted hig^, quality research and produced high quality research 
publications. Sevt^^l respondents suggested that additional publicity for 
the research- publications and services was essential. 

Survey Topic 3: Determine the Frequency of Ordering and the Relative Speed^ 
of Delivery for NASA Technical Publications 

Academic and industrial personnel were asked to respond to two questions 

concerning the ordering and delivery of NASA technical publication? . The 

responses Were summarized and are presented in- Table D. 

; ^ . • TABLE D , ^ X 

Summary:, Ordering' Frequency and Speed of Delivery '\ 
Fdr ^NASA Technical PublicatioKs • 



PERCENTAGES 



For my research, NASA 
technical reports are 
ordered: 



NASA technical reports, 
when ordered, arrive: 



< 
z 



o 

(0 



X 

t 

UJ 

z 



< 

X 



o 

(0 



> 

LJ 

> 



frequently. EH CH d] EH D infrequently 
• 16.0 25.2 . 25.2 10.0 10.5 

13. 1 not ordered n = 38.1 

iickly Slowly 
9.2 25.2 31.1 7.1 5.0 
0.0 do not arrive 
^22. 3 not applicable n = 296 



qiii 



Fortyone percent of the respondents indicated that they ordered NASA technical 
reports "very" or "3omewhat" frequently, while 35 percent indicated that the 
reports arrived "very" oi^ "somewhat" quickly. 



A stfaall number of opeil-ended Vesponses 'indicated th^t the. response time 
^fdr ^ordering technical reports ranged f r^ 3-6 weeks. One" Respond ei)t indicated 
that the recei^t-^ STAR "microfiche required 8 weeics. 

Survey Tet lc 4: 'Determine the Use of Non-NASA, NASA-Auth orfed, and Laneley- 
Authgr^d (Ptiblished) ^ 7; ^"^^ ^ 

'/^ ^spondents were asked three .questions designed to elicit their use of' 
j^blished scientific and technical information' (STI) . The responses were sum- 
matized and are presented in Table E. 

' ' TABLE E 



Summary: Use of STI 



PERCENTAGES 

1? 



Do you use 1ion-NASA published^ literature in your research 

a. Technical report literature 95.3 yes 2.4 no 2.4 N/A (No answer) n = 372 

,b.. Journal articles 96.9 yes 1.8 no 1.3 N/A . n = 376 

'C.- Conference/meetii^„pa|Jers . 96.1 yes 2.4 no l.^J .N/A n = 377 

Do you use NASA-Authored published literature in your research? 

a. Technical report literature 86.1 yes . 8.4 ircr .5.5 not sure n = 381 

b. Journal articles 84.4 yes ■ 9.4 no 5.8 not sure , '• n = 381 

c. Conference/meeting papers 85.8 yes 7.9 no 6.3 not sure n = 381 

a . ■ - 

Do you jise. literature published by the Langley Research Center in your tesearch? 

a. Technical report literature 75.1 yes 13.1 no 11.8 not sure " n .= 381 

b. Journal articles^ 71.9 yes 13.1 no- 15.0 not sure n = 381 
c^ Confer|pce/meet^nfg papers 74.3 yes 12.3 .no 13.4'^ not sure n = 381 

Approximately 96 percent of thg respondents Indicated that they used non-NASA ' 
published literature in their research, aric^ 85 percent indicated that they used 
NASA-authored published literatur*. Overall, 73 percent indicated that they 
used Langley published research- literature. However, approximately 13' percent 
could not distinguish LaRC from othef NASA-authored pu\)lished literature. 

Several respondents to the open-ended questions stated a preference .fof * 
the use of journal literature for disseminating and gathering research informa- 

■ ■ ■ ■' ' ■'■% 
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■tion. Some respondents considered the technical report an Important medium fo 
ptisenting complete research .information. 

Survey ^opic 5; Perceived Image of Langlev-Authored Sclent^f^r a n^ Technical 
Information ■■ ' : — - — 

Respondents were asked five ijuestions concerning the perceived image of 
Langley-authored STI. tThe ^e^sponses were summarized and are presented in 
Table F. ' * ' ' 

^ TABLE F 
Summary: ^J^^age of Langley STI ^ * 

PERCENTAGES 



5 

Z 

g 

OC 5 ^ 

.> 8 S 



UJ 
X 



Wl^en compared to other journal 
articles in my discipline, the 
PRESTIGE of Langley-autl^ored 
journal articles is 



When compared to other techn^-^. 
cal -report literature in my 
discipline, the PRESTIGE of 
Langley-^uthored technical' • 
reports is ^* 



When comf>ared Jo other' techni- 
cal report literature *in my 
discipline, the ADEQUACY OF 
DATA in ;:^ngley-authored 
technical reports is ^ 

When compared to other techni- 
cal reporfc literature, the 
ORGANIZATION (format) of 
Langley-authored 'reports is 

When compared -to other techni- 
cal report literature, the 
QUALITY OF VISUAL PRESENTATIONS 
in Langley-authored technical 
reports (e;g*, graphics, 
photography, type style) is 



higher □ Q 

, - ^ '9.2 26,0 41.7 

18 ri not familiar 
from Langley 

higher □ □ □ 

11.0 30.4 36.0 

' 17.6 not familiar 
■from Langley 

higher □ □ □ 

• 13.4 34.1 32.5 

18.4 not familiar 
from Langley 



< 
z 

I >• 

8 ^ 



readable [ ! | | f~] 
13.6 .33.9 32..3 

-vt 17.6 not familiar 
from Langley 



lower 

3.9 1.0 

with those 

n* = 381 
lower 

4.2.0.8 

with those 

\ - n = 381 

IjOwer 
1.3 0.3 * 
with .those 

n = 381 
less 



readable 

2.4 0.3 

with those / 
n = 381 

higher □ n GD □ □ lower 

3.1 0.5 
with* those 



16.5 33.1 49.1 

17.6 not familiar 
from Langley 



n « 381 



Thirty-five percent of the respondents indicated j^hat the pres^tige of Langley- 
authored journal articles was "very" or "somewhat" high when compared to other 
journal articles in ^their discipline. Sixteen respondents to* the open-ended 
questions indicated that journal publications were their preferred^edium for 
obtaining STI. Seven respondents encouraged Langley to make greater use of 
journal publications. Four respondents desired a publication listing recent 
Langley-authored journal articles. 

Approximately 41 percent of the respondents indicated that the prestige of 
Langley-authored technical reports was "very" or "somewhat" high when compared 
to other technical report literature in their discipline. Four respondents to 
the open-ended questions cited the importance of technical reports in publish- 
ing major results and complete details. Three respondents indicated that a 
recent decline^ in the technical quality of Langley §TI had occurred in their 
disciplines. Thre^ respondents indicated that varying levels of prestige 
exi'lsted for various technical areas at Langley^and, therefore, they found it 
difficult to generalize for the STI o\!itput of Langley. 

Forty-seven percent of the respondents indicated that 'the adequacy of data 
was "very" or '"somewhat" higher in Langley-authored technical reports than' 
other, technical literature in their discipline. Concerning the adequacy of 
data, three respondents. favored an increase in the publication of negative 
-resultsi: Three suggested that the reports should -contain a greater depth of dita 
analysis. Two respondents proposed that additional tabular data be provided 
in a separate report or ^crofiche. '* ' ' . 

Forty-seven perd'fent of the respondents indicated that the organization 
(format) of Langley-aythored technical reports was "very" or "somewhat" higher 
than other' technical report literature in their discipline. Four respondents 
to the open-ended questions Indicated that the text and graphical material . 
Sh^ld b£ integrated within the refport. Two respondents indicated a need for 
modern^tion of the format of the technical report, three respondents indi- 
catefthat the amount of narrative made the extraction of information difficult 
and two suggested simpler forms of repotts. 

Approximately; 50 percent .of fclie respondents indicated that the quality of 
visual presentation^. in Langley-authored technical reports was "very" or "some- 
what" higher than other techfiical report\l^terature in their discipline. Two 
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respondents desired the use of fin^ rather than coarse §rids. Three respondents 
indicated that the sketches and figures were too small to detect nuance within 
the data. * 

Survey Topic 6: Demographic Inf-ormatipn * • 

' The final set of questions i 17-25 on the survej^ instrument, was used to ^ 
elicit demographic information concerning the respondents. The responses to 
each question were tabulated and reported separately. 

r 

Work Experience . Respondents «fei:e asked to Indicate tlte^r number of years 
of professional work experience. The responses Vere tabulated and are presented 
In Table G. j^; ^ 

( * TABLE G . . ■ . 

Summary; -Y^ars of Professional Work Experience 

Percentage Years 

0.0 ♦ * Less than one year 

7.9 6-10 

22.1 , < 11-15 

21.3 " 16-20' 
45.8 21 + 



100.0 n = 380 

t — 

Eleven percent of the respondents had worked professionally "f^r less than 
11 years. Twenty-two .percent of fhe respondents had between 11 and 15 years • 
of professional work experience. Sixty-seven percent of the respondents had 
wojrked professionally 16 or more years. 

lii^ ' ' ' / 

^ Organization Type . The respondents wfere iderttif ied by organization affili- 
ation. The responses were tabulated and are shown in Table H.. 

TABLE H . 

Summary: Type of Organization 

Percentage Type Organization 

67.2 Industrial Organization 

3.7 Not-for-profit Organization 

* 'Jir28.1 Educational Institution 

1 tO \ Government Agency 

100.0 n - 381 
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Sixty-seven percent of t^e r^spond^ts were associated with industry, while 
28 percent were associated with educational institutions. The remaining 5 per- 
cent were associated with not-for-profit organizations an^ government agencies. 

Professional Duties > The respondents were asked to indicate their profes- 
sional duties. The choices included b^sic/applied research, teaching/academic, 
and private consultant /technical administration. The results were tabulated^nd 
are shown in Table I. v 

TABLE I ' . ^ \ '^--1-. 

Summary: Present 'Prof essional Duties 



.percentage - ^ Vrofessional Duties 

51.8 Basic/Applied research . ^ 

23.5 Teaching/Academic (may include relearch) 

* * 24.7 ^ Private consultant /Techi;iical administration 

, 100-0 ' ^ ' , n = 380. 

Approximately 52 percent of the respondents indicated basic/applifed 
research as their professional duties. The remaining 48 percent were divided 
nearly Bq^ually between teaching/acaddmic (may include research) and private 
consultant/technical administrative duties. 

• # 

Major Field . Respondlehts were asked to specify their major field of 
interest. The five category choices included aeronautics/astronautics, chemistry 
and mat^erials/physics, math and computer science, geosciences/lif e sciences/space 
sciences, and engineering only. The results were tabulated and ar^ shown in 
Table J. . ^ - ^ V 

TABLE J * ft ' 

Summary:- Major. Field of Interest 

gerpentage Professiortffa Jield 

- 40*3 AerQjtiauticls/Asttonautics ' ^' ' 



7.2 Chemistry and Materials/Physics ' ^ 

12.2 Math and Computer Science J 



8-5 ■ Geosciences/Lif e Sciences/Space Sciences 

31.8 ^ Engineering only . ' ' 

100. 0 . ' .\ - • n = 377 
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Forty percent of the respondents identified aeronauticS'/astronautics as 
their'major field of interest. Seven percent .identified chemistry and materials/ 
physics? Twelve percent id^tified math anc^ computer science, while approx- 
imately 9 percent identified gedscience/life sciences/space sciences. Nearly 2i2 
percent \dentifed engineering as' their major field. of interest. 

* Publishing > Questions '21-23 respectively were concerned with the impor- 
tance of publishing, management support of publishing, and whether the respon- 
dents had published. The results 'were tabulated and are shown in Table K. 



/ , TABLE K 

Summary: Advancement Through Publication, Publication Support, 
and Publication Experience 

PERCENTAGES 



In terms of my profes- 



is: 

Regarding publication,- 
my tnanagement is: 



Do you publish? 

Do publish 
^ €)o not publish 



Percentage 

92.8 

7.2 
100. 0 



ERY 


5 . 

X 

s 


EITHER 


3MEWHAT 


ERY 


□ 


□ 


Z. 

□ 


CO 


P 


40.-4 


25.7 


16.3 


12.1 

1 


5.5 


□ 


□ 


□ 


□ 


□, 


45.3- 


29.2 


18.9 


5.3 


r.3 



n = 381 

nonsupportive 
n ^ 380 



n = 376 



',;Nearly all^of the respondents published, while approficimately 67 percent 
indicated that publishing was "very" or "somewhat** important to their careers. 
Approximately 75 percent of the respondents indicated that management was **very*' 
or **aomewhat** supportive regardirig^publication. 

NonTNASA Technical and Professional Conference * The respondents were asked 
how many technical/professional conferences (e.g., workshops, symposia, meetings) 
^other^han NASA conferences thej^ had attended within the past thtee years. The 
results j£er€^abulaj:ed an^ are shown in Table L. ^ 
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TABLE L 



Sumnary; Attendance at Mon-MASA Conferences 



Conferences 


Number jot 


"^Percent 


None 

One ' ' 
Two 
Three 
Pour 

Pive ' ^ 
Six 

Seven <. 
Bight 

Nine or mpre 


1 6 • 
14 

52 V 
• 22 

>2 
/20 


> 4.2 

y 9.K 

^ 13.6 

5.8 **. 

\ 3.4 
6.3 
3.1-6 


Total ^ 


/ ^81 


100.0% 
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Nearly 32 percent of the respondents had attended nine or more conferences^ 
within I the last three years. Approximately 68 percent of the respondents had 
attmdid between one and eight conferences, liearly^ 51 percent of the respon- ' 
dent's ]^d attended betweien, two tad six conferences within the past three years. 
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^ ; TABLE M 

Suiinary: Att;endance at K^A Conference 



Number 0^ 
Corif erences. 


Number of 
Respondents 


Percent 


None 
- One 
Two 
* Three 
\ Pour 
Five 

Six ^ ^ 
Seven 
Eight' 
^ ^Nirie or more 


« 

90 - 
95 

J-5 

. 15 ■ 
13 
4 

1 . 


20.5 , 
: 23.6 

./--24iS^ 

3.B' 
1.0 
0.3 . 
, -3.1 


/Total ^ 




100.0% 



Nearly 64 perdent of the respondents had attended between one and three 



* NASA conferences during the. past three years. Twenty percent had not attended 
•a NASA conference during the past three years. 



Survey Topic 7; Identify Ways in Which NASA and I^ngley-Generated STI Could 
Be Made More Accessib le to Non-NASA Engineers .and Scientists , 

: ' ' ' 

A total of 128 open-ended responses addressed some aspect of acdes^ibility 
of NASA and Langley-genei^ated STI. These responses were analyzed and ^e pre- 
sented by togic. ' ^ " " ^ ' 

A total of eighty responses to- the open-ended questions focused on the / 
Agency's publication, announcement, and dissemination practices. Nineteen ' 
respondents indicated that NASA dhoul^ educate usets and potential user& about * 
the rai^e of NASA publications and how to obtain them.' Seven respondents sug- 
.gested that NASA advertise^ subject-specific research publications in appropriate 
. open:^iterature joiii:nals and periodicals. Four respondents suggested that NASA 
advertis^Mrhe announcement journals, STAR and lAA, in the^ open literature. Fou^ 
respondents commented that a lowered perception of the* quality of NASA publica- 
tions resulted from their -lack of visibility." T^ respondents suggested addi- 
tional ways to announce NASA's published research. 

i 

Five of these individuals recommended that all recent publications should 
be listed in newsletters on a monthly or quarterly basis, possibly with brief 
reviews and stabjectr indexing. Five individuals preferred that NASA produce 
subject-specific newsletters or reviews: Concerning dissemination of all 
announcements of published rejearch, 14 respon(3|^ts indicated that the mailing 
should be,, directed at interested individuals as well as organizations. 

Seven respondents commented on the long delay betweenjth^conduct of 7 
research and the publication^or^annoO^^ * Five iridividuals ^ 

expressed dissatisfaction with the delivery time for reports. 

At both -Agency and Langley levels, seven individuals desired information 
about work in progress, including a contact for obtaining further information.^ • 
^Four respojidents suggested that this preliminary information was -preferable 
to the long wait for published information about completed research. Four 
respondents desired information about planned projects. ^ 

' Six respondents commented hn difficulties concerning Contractor Reports 
(CR*s). pie responses indicated that CR*s were not uni^rmly clear and factual, 
that the/publication process took too long, and that it was difficult to obtain 
copies ;^f the reports. . - ^ 
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Four respondents, who identified *tliemselves eLs taxpayers and/or 
con tract or /gran tees, desired to obtain free copies of publications important 
to their research. ^ 

There were 24 responses directly concerned with the accessibility of - 
La^ngley STI' either through the use of Langley-authored publications or through 
' personal 'contact . Ten respondents stressed the importance of personal contact 
and expressed their satisfaction with the accessibility of Langley personnel. 
Six respondents conmented that they had obtained copies of reports' from the 
author when they needed the information quickly. Ten respondents suggested 
that dddlitional ways of announcing Langley STI should be employed on a monthly 
or quarterly, basis and be directed at individual researchers. Six of tKese . , 
respondents indicated that each publication be limited. to a specific subject 
category. Fbur respondents , wanted the publication 'to ai>nounce all current 
Langley STI, Three respondents^^eslred that a source for. further information 
be identified for inform^tion^n ordering or obtaining Langley reports. 

' ' ■ FINDINGS ' 

7 

TJie findings were summarized ^nd are presented for, each survey topic. The 

following descriptors were used ^ to present the findings: 

Plurality - the largest group, but less than half of the respondents 

< Substantial - an opposing response pf 25% or more ... 
^ Minority ' T--^ 

Majority - 50 to 59% of the respondents < 

Clear - 60 to 69% of the respondents 

Majority , ^ . ^ 

Strong - 70 to 79% of tlie respondents 

•Majority - . * : / , , ^ 

Overwhelming - 80% or more of the respondents* ' * 

Majority 

Survey Topic 1: Assess the Familiarity With and Use-t»§^>.SBlecLtied,.^^ STI 
Publications and Services / ' * 

An overwhelming majority of the respondents indicated that their 

organlzaflon/institution subscribed to or received NASA technical reports. A 

clear majority indicated that their organization/ institution subscribed to or 

received STAR, while a substantial minority did not know whether their organi- 
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zatian subscribed to^ received STAR. A plurality indicated ^that their 
^ organization/institution subscribed to-IAA, while a slightly smaller percentage 
did not know whether their organization/institution subscribed to or received 
lAA. 

A^iflajority of the respondents "usually" or "sometimes" used STAR. A 
bubstantial minority were "unfamiliar with" STAR or did not respond. 

A. plurality of the respondents "usually" or "sometimes" used lAA. A 
slightly smaller percentage were unfamiliar with lAA or did not respond/ 

A clear majority of the respondents were unfamiliar with SP-7037. Twenty 
percent of the respondents indicated that they never used SP-7037. 

Responses to the open-ended questions incPicated that several respondents 
*were not sure which NASA publications or services had been used by their organ- 
ization's library to supply the information they used. Some respondents com- 
mented that STAR was valuable for' their_i:esear<ih , while others either had diffi- 
culty obtaining the organization's copy or found STAR too voluminous to use 
efficiently. . 

^ Survey Topic 2; Assess the Importance of NASA STI and Langley-Authored 
(Published) STI in Terms of "Advancing the State->of^the-Ai:t" 

A strong majority of the respondents indicated that NASA STI was important 
for their research. Ag overwhelming majority indicated that NASA STI was impor- 
tant in "advancing the state-of-the-art." A strong majority indicated that 
Langley-authored STI^was important iA "advancing the state-^of-the-art . " 

Survey Topic 3; Determine the Frequency of Ordering and the Relative Speed . 
of Delivery for NASA Technical Publicati ons 

A plurality pf the respondents indicated that NASA technical ^reports were> 
ordered /frequently. A substantial minority indicated that NASA technical 
ret)Qrts were ordered "neither ' frequently nor infrequently." A plurality indi- 
cated that NASA technical reports arrived "neither quickly nor slowly." 

Survey Topic 4; Determine the Use of Non-NASA, NASA-Authored^ and Langley- 
Authored (Published) STI : . , ^ ^ 

' * An oveijwhelming majority' of the respondents indicated that they used 

nd^jj^ASA^ published literature in their research. An overwhelming majority 
^ Indicated that they used NASA-authored published literature in^thelr research. 
A strong majority indicated that they used literature published by the Langley 
Research Center Iti their research. ^ 
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Survey T opic 5K Perceived Image of Langlev-Authored Scientific and Technical 
Information 

A plurality the respondents indicated that the prestige of Langley- 
autJiored jourwal" areicles was "neithfer higher nor lower" than other journal 
articles in their dis^p^^i/es . A substantial minority indicated that the 
prestige of the LangleyXduthored jouffnal articles was high compared to other 
Journal articles in their ^disciplines. Sixteen of tM respondents to the open- 
ended questions indicated that they pref erred„joumal publications to repbrt 
literature as a source of ti^clmical information. 

A plurality of th^ respondents indicated that the prestige of Langl4y- 
authored technical reports was high compared to other technical report litera- 
-ture in their disciplines. A substantial minority indicated that the prestige 
of Langley-authored technical reporta, was "neither higher nor lower" compared 
;to other tecl^nical .report literatyre^n their disciplines. 

A plurality of the -respondents indicated that the adequacy of data in 
Langley-authored technical reports was high compareS to other technical report 
literature. A sub^tahtial minority indicated that the adequacy of data in 
Langley-authored technical reports was "neither higher nor lower" than other 
technical report literature. 

A plurality of the respondents indicated that the organiz4tion (format) 
of Langley-authored reports was more i^ad^J^le than other technical report lit- 
erature. A substantial minority indicted that the organization of Langley- 
authored reports wa^^^ "neitheir more nc^t less readable" compared to other techni^ 
cal report literature. y 

A majority of the respondents Indicated that the quality 'of visual 
presentations in Langley-authored rjeports was high compared to other technical 
report literature. A substantial minority indicated that the quality of viiual 
presentations of Langley-authored reports was "neither higher nor lower" than 
other technical report literature. — — 

Survey Topic 6; Demographic Infarmation 

An overwhelming majority qf the respondents had more than ,11 years- ' ' " 
professiohal work,' experience . ^ t>lurality had worked prof e,ssijbnally more 
than--21 years. , " \ * " / 

A clear majority were employed'sby an industrial organization jand a %. - 
substantial minority were em/loyed within the educational prof ess Jon."* ' ^ .' ' 

• , , ' 25 •/ / 
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A majority of the respondents were engaged In basic or applied research* 
A smaller gtoup of respondents were engaged In private consultant or technical/ 
administration duties* The smallest group of respondents were engaged In teach- 

•a f 

log or academic duties which may have. Included research* 

A plurality of the respondents Indicated that aeronautlcs/astronau^lcgi was 
their major field of Interest i A substantial minority Identlfle^^-engineerlng 
as*thelr major- field of Interest. v ^ 

A clear majority of the respondents IndlcatW that publishing was Important 
for their 'advancement/development* A clear majority Indicated that management 
was supportive regarding publication. Responses* to Item 23 had to" be re- 
categorized Into* those who published and thbde who did not publish. An over- 
whelming majority oi^ the resppndents indicated that they published. 

A clear majority of respondejits indicated that they had attended one to 
eight non-'NASA conferences (workshops, symposia, meetings) within the last three 
years. ^A clear majority of the respondents indicated that they/had attended one 
to three NASA'^oijferences within the last three, years r « 

Survey Topic 7; Identify Ways in Which NASA and Lanfeley-Generated STI 
Could be Made More Accessible to Non-NASA Engineers aipd Scientists 

Survey topic 7 was an open-ended question concerning the accessibility of 
NASA and Langley STI. The 128 responses coWxed numerous aspects of accessibil- 
ity. Use of the descriptors "plurality," "majority^" etc., were therefore net 
used to present the findings for this topic. 

o Increase visibility of. STAR and lAA 

Respondents suggested that th^ announcement journals STAR and lAA 
be advertised in the open literature journals. * ^ 
p Develop additional announcement techniquea / 

Respond ene&\8uggested that additional waysjof iuforming.',tisers about 
NASA md Langley pu|^iy.8Hed jresearch be developed. 

^ o^ Identify authdrs ami 'STI contacts ^ ^ , - 

Respondents Suggested that the names of author (s) or contact (s) be 
.Included with All annofcncejnents of completed, in-progress, or planned research. 



t) Identify wortTirT progress and planned research 

^^--^Respondents suggested that information concerrtliig*'*'6n^oi^^ and planned 
research be published to aid in planning and^jsupporting their own efforts, 
o Educate users and^^tentjLai-nlse^ ^ ' e> 

Respondents-STllgeste^^ more information about ordering N/^A 
igiey reports be provided, 
o Include interested users in all announcements 

Respondents sugg^Qted that individuals as well as organizations be 
included in all NASA and Langley STI announcements 

o Publish both general and specific announcements 

Respondents suggesjted that two types of announcements be used, one 
which included all subject categories and one which was subject-specific, 
o Speed up di$tribution of reports 

Respondents commented fhat the delivery time for reports on automatic 
distribution and ordered reports was "sometimes too long. 

CONCLUSIONS AND RECOMMENDATIONS , 

V ^ ^ , . . 

They analj^sis of the data r^yeal^d that- NASA STI was important to the 

research conducted by the majority of the respondents and that the majority of 

tespoiments viewed NASA STI, as important in te^s of "a'dvancing the state-of- 

--the ^t." NA§A and Langley STI was used by 85 and 74 percent, respectively^ of 

the respondents. NASA and Langley-authored technical reports, journal articles, 

and conference/meeting papers were used equally by jbl strong majority of the 

« . » . — ^ — ^ 

respondents. The analysis of the responses indicated a significant lack of 
familiarity with and lack of use of selected NASA STi products and services. 
This is in direct contrast to the number (83 percent) of respondents who indi^- 
cated that their organizations subscribed to or^ received NASA' technical reports. 

The responses to the closed-ended and open-ended questions were used to 
establish a perspective for the survey topics. These responses were analyzed 
to form conclusions which are jj^esented for each survey topic. Recommendations 
were made based on the conclusions and are presented for each survey topic; 

Survey Topic 1; Assess the Familiarity With and Use of Selected nAsA STI 
Publication^ and Services 

'While NASA technical reports were subkcribed to or received by the majority 

of respondents, the respondents were unfamlUar with STAR, lAA, SCAN, RECON, and 
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NASA'SP-7037 (27,^2, 5f, 30, and 64 percent, respectively). With the under- 
lying assumption that increased use would result from increased familiarity, the 
processes used by the NASA STI system to familiarize academic and industrial 
engineers and scientists with NASA STI products and services sho\ild be reviewed r^' 

Recommendation t A stydy to determine how NASA STI products and services 
are publicized and announced should be undertaken. Particular emphasis should 
be placed on how NASA informs users and potential users about the STI products 
and services. 

Recommendat ion ; A study of the current NASA dissemination program, which 
^ uses librarians and information specialist's as gatekeepers, should be undertaken 
to determine how NASA products and services are publicized within affiliated 
organizations. Mong€^(1979) reported that newsletters prepared by corporate 
librarians and information specialists were the most frequent ways in which 
engineers and scientists learned about NASA publications. A study of the cur- 
rent dissemination program should focus on making the system more effective in 
terms of reaching the user. 

Recommendation ; A study to determine how the utility or use of NASA STI 
products and services could be increased should be undertaken. In-depth inter-, 
views and questionnaires should be included Ini the study. Particular emphasis 
should be placed on existing products and servjLces with the idea of modifying 
them or creating new ones. 

Survey Topic 2: Assess the Importance qf NASA STI and Langley-Authored ] " 

(Published) STI In Terms of "Advancing the gtate-of-the-Art^'^ 

An overwhelming majority of the respondents considered NASA STI important 

for "aivancliig -t4ie--&^e--of-t-he-art"-and a strong majority considered NASA STI 

imp6rtant for their own research. While 75 percent of the respondents used 

Laiigley-authored (published) literature, only 55 percent considered it importaitt 

^tt ^"advancing the state-of-the-art." 

Recommendation ; Based on a survey of aeronautical organizations, Mong;^ ► 
(1979) recommended that NASA produce more publications on the "state-of-the-art" 
in majar research areas. Since Langley is so heavily oriented toward aeronau- 
tics, Langley authors should be encouraged -to prepare more "state-o^-the-art" 
publications. These could be prepared as NASA reports,, journal articles, and 
meeting/ conferenc e pap ers. 
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Recommenda tlonx ^ppT^jSma t elv 40 percent of the survey population identi- 
^^^^^jEJ^-^iflng'fdnautics/astronaut as their" major field of interest, yet 64 percent 
were "unfamiliar with" NASA SP-7037 (Aeronautical Engineering Continuing Bibli- 
ogrHphy). Special attention, should be given to .increasing the scope of^his 
series of reports and increasing the awareness of their existence among users 
and potential users ^f NASA STI. 

Survey Topic 3: Determine the F*requency of Ordering^nd the Relative Speed 
of, Delivery for NASA^Technical Publications ' ^ ' 

A plurality of th^ respondents had ordered NASA technical reports for their 
own research and ind^.cated that the reports arrived quickly. Nearly 24 percent 
Qf the respondents either didn't order NASA reports or ordered thed very infre- 
quently. 

Some respondents to the open-ended questions, however, comment 2cir that there 
was a long delay in the receipt of reports. None of ±he respondents Reported 
the lack of receipt of ordered reports. This is Qontrary to the findings of 
Monge (1979) who reported that 20 percent oi the STAR' reports ordered by respon- 



dents nfever Arrived. 



Recommendation ; As part of a study of the NASA dissemination program, 
questions on orde^ring of reports shexild be lnclu^4l?in th^ personal interviews 
and questionnaires. .This would provide information to resolve the apparent^'lf- 
ference between the findings of the two studies. r 

Survey Topic 4; Determine tKe Use of Non-NASA, NASA-Authored > and Lan gley- 
Authored (Published) STI \ 

^overwhelming majority (85 percent) of the respondents used nOn-NASA and 
NASA-authored litera|:ure in' their research. 'A strong majority (74 percent) used 
literature published by the Langley Research Center in their research. ^\ 
three media (t^dhnical reports, journal artifrles, dnd conference/meeting papers) 
Were equally .Well used. 

Conference/meeting papers were used by 96 percent of the academic and 
industrial engineers and scientists surveyed. The Langley Research Center conr 
^ tinues ,to make a concerted effort to document (publish) conference/meeting 
^ papers,- . When Langley is a sponsor or a co-sponsor, efforts are made to publish 
3|the proceedings of a conference as a NASA Conference Publication (CP). Recent 
changes byt^e NASA Scientific and Tefchnical Information Branch (STIB) have • 
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substantially Increased the distribution of NASA dP**8. However, papers appearing 
in NASA CP's are not accessioned and announced individually, a practice employed by 
■ S^gt em^ within the federal government* 

Recommendation ; Under the guidance and direction of Headquarters* Scientific 
and l!echnical Information Branch, NASA should encourage* doctunentat ion (publish- 
ing) of NASA-authored conference/meeting papers and should consider the indexing 
and announcement of individual , conference/meeting ^papers, 

' . Recommendation : jThe- Research InfopmatjUon Applications ^Division (RIAD) 
at Langley, with support frcto Center.^nagement,' should encourage the docu- 
mentation ^f conferences and meetings, in particular, the research output 
which is reported in the annual STI output book as unpublished research. Con- 
tinuing efforts should be made to document (publish) the proceedings *of Langley 
sponsored and co-sponsored conferencej^^Vmee tings, and workshops. 

Survey Topic 5: Perceived Image of 'Langley-Authored Scientific and 
Technical Information (STI) 

Four questions were included in the survey of academic and industrial engi- 
neers and scientists (the external group) to establish the perceived image of 
Langley-authored STI. * These questions w,ere similiar to ,the four questions cover- 
ing the same topic in the survey of Langley research personnel' (the internal 
group) . Conclusions were drawn for each of these questions based on a compari- 
son of the data derived from the two surveys. . 

Langley research personnel were more positive in their rating of the 
prestige of Langley- authored STI than were the external group. The prestige 
of LangXey-authored journal articles was rated conslHerably higher by the in- 
ternal group (70 percent) than by tl\e external group (35 percent). The prestige 
of Langley-authored technical reports was rated more closely by the internal 
group (56 percent) and the external group (41 percent). However, a perception 
of low prestige for the Langley-authored technical report was indicated more 
frequently by the internal group (25 percent) than by the external group (5 
percent). Overall, the internal group attributed higher prestige to Langley- 
authored journal aifticles than did the external group a^d lower prestige to 
Ei^ngley-authored technical reports than did the external group. 

The adequacy of data in Langley*-authored technical reports was rated higher 
by the internal group (73 percent) than by the external group (48 percent). 

* » 
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Neither the internal or external groups indicated that the a^equacy^Df data- In— - - 
Langley-authored technical reports was low. Monge (1979^^ reported that insuffi- 
cient data was a major inadequacy of NASA Reports. The results of the inter- 
nal ai^d~ external surveys did not confirm Mongers findings. 

f *The internal^roup was mor^positive (78 percent) than was the external 
group X48 percent) in the opinion that the organization of Langley-authored 
technical reports made them more readable. Neither group reported that the ' 
organization (format) of liangley-authored technical reports made ^hem less ^tead- 
able. Monge (1979) reported that the organization (format) of NASA reports made 
them less readable and suggested that NAS^ prepare general guides for technical 
report preparation. 

Reconmendatlcm : Although NASA has publication guides which are contained, 
in NASA SP-7013, it is quite possible that not all centers are adhering to the 
established format. A study should be undertaken bji-NASA Headquarters, STIB 
to ascertain the extent to which technical reports produced by the various 
centers conform to established NASA publication guidelines. 

Recommendation; The^ review of related literature produced little enipirical 
research relative to the use of technical reports by engineers and scientists. 
As part of the follow-On activities for the Latigley SJI review and evaluation - 
project, a study should be undertaken to determine the usage of technical report 
components and establish theVost effective organization and sequence. 

The question concerning the quality of visual presentation of Langley- 
authored technical report/ was asked only of the external group. Approximately 
50 percent of the respondents indicated that the quality of visual presentation 
in Langley-authored technical reports was higher when compared to other techni- 
cal report literature.' At present, approximately 80% of all repo^' on automatic 
distribution are on microfiche.^ This practice necessitates high levels of 
legibility. Monge (1979) reported that executives and researchers had many 
criticisms^ the^graphs, type size, and type style used in NASA technical 
reports. Monge. rsugges ted that standards for legibility were essential, consider- 
ing the average age of his survey population (47 years of age with' 21.5 years of 
professional experience). tThe age and years of professional work experience of 
Mbnge's population were highly similar to those of the internal and[ external 
groups. V . . j 

Recommendatibn; Although the findings of Monge- were not confirmed by the 
responses of either the internal or external groups, it is possible that the 
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ality of visual presentation in NASA technical reports may not be uniformly 
High. A review^r^TRe^suat standards employed as part of the NASA p\iblica- 
tion^ standards for technical reports should be cohduCte** — ^Ifliej:jB^goS8ibl^^ 
.exist infesStandards should be compared wdth standards existing elsewhere. Where' 
no Standard are prescribed in the NASA publicat4.on program, they should be 
developed anoxoromulgated. ^ . % 

Survey Topip 6; Qemographic Information 

The demographic^ information for the external group closely paral^led that 
of ^the internal group In teras of age and years of professional work experience. 
Like the internal group, the external group indicated that publishing was impor- 
"^tant to advancement and that their management was suppojrtive of publishing. 

As with the internal group, the Oj/erwhelming majority of the external group 
published. The major fields of interest of the external, group by STAR category 
closely paralleled the research output of the internal group. 

A clear majority of the external group indicated -that they had attended 
between one and three NASA conferences vithin the past three years. In terms 
of .attendance at non-NASA conferences, the external group, on the average, 
attended three times as many conferences (workshops, symposiums, and meetings) 
than did the internal group. 

• , ^ ■ 

Recommendation: Despite the continuing reduction in travel dollars, some 
attempt should be made to facilitate greater attendance by Langley research 
personnel at non-NASA cohferences. 

Survey Tog^ic 7; Identify Ways in Which NASA and Langley-Generated-STI 
Could Be Made More- Accessible to Non-NASA Engineers and Scientists 

^ This topic was an open-ended question concerning the accessibility of NASA 
and Langley STI. The 128 responses covered numerous aspects of accessibility. 
Much of the information desired by the external group is presently provided by 
the NASA STI system. Names of authors are provided in all announced STI. On- 
going research and planned^ research are announced in STAR. The publication 
SCAN, which is available to the external groyp, provides individual access to 
information by specif ifearea(s) of interest. In addition to the RTOP's 
(Research and Technology Operating Plan) published in STAR, each NASA Center 
publishes an annual Research and Technology Report which gives highlights of 
reseatch being conducted. , 
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Recommendation ; A program should be undertaken by Headquarters STIB to 
make the research community aware -of tha products and services offered through 
the NASA Information System. This program, should focus on the librarians and 
. informatidn specialists who serve as gatek^pers within the current distributive 
system and the individual engineers and Scientists who are users and potential 
users of t^he NASA STI system. Promotional materials should be developed and 
distributed /using the mailing lists for technical organizations and societies. 
' Articles fn the open literature and presentations st^t^d be used by STIB per- 
sonnel to promote awareness. The awareness, program must include both internal 
and .extemaj>»s€^. PROFILES should be updated and distributed to NASA research 
personnel through workshops at the Centers. , Feedback should be continually 
solight from internal and external users which would be used tp plan and update 
STI products and services.*^ 

Much of the .information desired by academic and industrial respondents 
concen^ing Langley-authofed and -sponsored; STI is currently available in the 
annual STI output book. The 1980 edition contained several new^ features 
designed to enhance the usefulness of the output book." The catlgories were 
expanded to include Comput;er Programs registered' with COSMIC, Tech Briefs, and 
Patents. In addition, the output^book contained an author, subject category, 
RTOP, and, Tech Brief index. Emphasis was placed on archival or "published" 
research. Particular care was taken to provide complete citatiofts including 
source of availabflity . .Complete journal citations and the availability of 
conference /meeting papers were provided. ^ 

The distribution of the output book was significantly increased this year. 
J3ie-H3Ufeput__bpok jras^ibliahed-^ Memorandum (TM) . This means 

that the report was accessioned into the -NASA STI data base, announced ip STAR, 
and made available- for public sale through NTIS. Copies of the output book 
were distributed to academic, industrial, .and government libraries. Each STI ' 
coordinator provided names ancj addre'bses of individuals to receive copies of 
the output book. Members of certain N^A advisor^ committees received, a copy ^ 
Of the'' output book. Approximately 2,200 copies were distributed. 

Recommendation; The new features present in the 1980 output book should ' ' 
bi included in future editions.- Each- STI coordinator should encourage the ' 



research personnel within his/her division to continue to submit the names of 
Interested individuals^ to receive copies of the output book. 

The agency's Automatic" distribution system for technical publications is 
organizational in nature. These reports are distributed to institutions and 
organizations, not individuals. To foster a more timely dissemination of info 
mation to the individual users and to promote greater exchange of STI between 
scientists » Langley research personnel are provided author copies of theit 
reports for scientist-to-scientist exchange.' 

Recjommendat ion ; Langley 'Research Center should strive to develop a^ec- 
ondary distribution progra^^^r Langley-authored formal series technical^publi 
cations. This program could be inaugurated bV -^RIAD with the help -of the STI 
coordinators and should include the compiling of a computerized mailing list 
containing the names of engineers "and scientists in industry, academia, and 
government who are conducting, similar research. Finally, consideration might 
be given by RIAD to increasing the number of author copies of ^Langley-authored 
formal series technical publications to the extent permitted by federal law 
and Agency regulation. 
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- PINAL REVISION 

APPENDIX A • 
A PROJECT PLAN FOR THE REVIEW AND EVALUATION OP THE 
^ LANGLBY RBSEARCT CENTOR'S SaSNTIPIC AND TECHNICAL INFORMATION PROGRAM 

INTRCH)DCTI(W 

One of the mo6t important results of exploration and research and develop- 
»ent' is 'information.. The National Aeronautics and Space Administratioirs scien- 
tific and technical information system is one of the largest and best known 
federal STI pfbgrams in tlie* cjbiintry^.^ The mission of the NASA STI is two-fc^r 
0) to acquire worldwide research in aerdnauticsr space, and related disciplines 
to keep NASA personnel abreast of current activities and develojaien^ff; and 
(2) to contribute to the expansion of STI through timely dissemination of NASA- 
generated and. -rsponsored reseeurchr developmerltr testing") and technical evalua- 
tions. The Langley STI program is an integral part of the Agency's 6tI program 
and is responsible for lmpl«nentlng Agfency and Center policies concerning 
the management of STI. Expeditious publication of the Center's research is 
Langltfty's contribution. to the Agency's goal of timely dissemination of NASA 
research. * - 



-J 



BACKGROUND 



^ . The Langley Research Center (LaRC) is one of the leading national labora- 
tories for research and development in t'he sciences ot aeronautics and space 
tecshnology. Pounded iii T91,7r Langley was the nucleus of the former National 
A<)vi80cy Coafcittee for Aeronautics (NACA). For more than 60 years ^ Langley 
engineersr scieHtistSr and technicians have been conducting basic and applied 
research In fluid and flight mechanics, flight systems, structures and materials, 
aoou8£lc8 and noise redufcticxi, measuranerits and instrumentation systems, data 
systems, .and space and earth sciences. ^ The results of this research are dis- 
seminated through NASA scientific and technical publications as well as non- 
NASA^media: such as technical or professional society journals and similar 
periodicals; domestic and foreign presentations of papers, talks, and lectures; 
a^d ia the proceedings of conferences and symposiA. For calendar year 1980, 
Langley U T^aaS engineers /and sciefttists produced 1127 items which included 
175 NA3A formal series technical publications; "136 N^ Quick-Release Technicar 
Memorandtka; 146 journal articles; 352 conference/meeting papers; 85 NASA 
TedJ Briefs; 10 NASA computer ^programs; 20 patehts; and 203 pieces of unpub- 
>llshea research. The documented research output of the Langley » Research Center' 
is j)rpcessed through the Langley Research Information and Applications Division 
(RMD)^ which is an integral part of the NASA Scientific and Technical Informa- 
tion system. • | 

^ . '. • 

K - 

^ STATEMENT OP THE PROBLEM 

- •! 

During the 63-year \history of the Langley Research Center, a comprehensive 
ireview and evaluation ofti the. Cienter • s STI program has never been conducted. 
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Portions of the Center's STI program have received periodic or occasional 
assesanent;' however/ no valid ^pirical data exist which can be used to. 
evaluate the total program's efficiency and effectiveness. 



PURPOSE OP THE PROJECT 

'A^oomprehensiye review/evaluation of the Center's STI program will seek to 
determine the extent to which the program is meeting the needs of Iiangley 
resezucch and professional personnel and the recipients of Langley-generated 
scitBntific and technical information, the areas or portions, of the program which 
need improvement, and ways in which the program can be modified to improve its 
overall efficiency and effectiveness. In conjunction with the evaluation proj- 
ect, a theoretical and analytical revdew of the NASA formal report as a medium 
for information transmittal will be conducted. The results of the project may 
enable NASA to develop a more effective medium for transmitting the results of 
its ifesearch. 

Objectives for the Project 

Ten objectives were established for the project. These objectives were 
to ' 

1 . Assess the knowledge of and attitudes toward the Langley STI Program; 

2. Assess the knowledge of and attitudes toward HASA and Langley STI; 
3« Determine the information needs of Langley and NASA STI users; 

4. Establish the perceived usability,- techiiidil quality, and prestige 
of Langley STI; • 

5. Assess the adequacy, quality, and timeliness of research support 
services provided by the Langley STI program; 

6. Determine the familiarity with and use of selected NASA STI products 
and services; , ^ 

7. Determine if the dissemination of Langley STI could be made more 
effective; 

^ » 

8. Determine if the dissemination of NAS^ STI could be ma^e more effective; 

9* Determine the effectiveness of the Center's policies and procedures 
for processing/publishing Langley STI; ^d 

10. Develop a selected, annotated bibliography on the design and evaluation 
of STI systems. ^ - * ^ 
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Oyetviw 

The project will utilize both sidrvey research and systems analysis techni- 
ques and will be directed by Thomas E, Pinelli, Assistant Chief, RIAD, A steer- 
ihg oo^pittee of 17 individuals will be used to help focus, develop, and guide 
the project through its completion, ^ Each research divisiqn will nominate a 
representative to serve on the committee. The Chief of the#»Scientific and Tech^ 
hical Information (STI) Branch, NASA Headquarters, will serVe'as an ex-officio 
member of ^the committee. The individual tasks established for the project will 
be executed using Lan^ley, Old Dominion University, and professional contract 
personnel. / ' . 



Limitations 

—. . / 

The project wiU be -limited to the scientific and technical information out 
put of the Center as processed or disseminated through tlje^angley STI program. 
The project is not concerned with either informal tran^r or secondary applica-' 
ticm of the Center's research output. The project will involve researchers at 
the Langley Research Center and NASA information users in other government 
agencies, industry, and academic institutions; 



IlEVIEH OP RELEVA19T RES^CH 

^ A se^rch^is underway to identify literature relevant ^Hhe project. The 
resjiTtrof Langley and Headquarters' ^Tl studies and assessmen^x<x)nducted since 
^1368 will be collected and used to help develop the research methodology for the 
project. A. review of STI systems, STI models, and a review of STI evaluative 
activities will be undertaken. 



I . r RESEARCH METHODOLOGY 

The project will investigate the effectiveness and efficiency of the 
penter's scientific, and technical information program, with particular «nphasis 
placed on improving ithe effectiveness of the dissemination process. The speci- 
fic actions to be taken are described in the following phases. 

Phase 1\ Knowledge! and Attitudes Survey^ Langley Research Pergbnnel 

t * 

Phase I of the j review and. evaluation project requires an assessment of the 
adequacy of the Cmter's STI program in meeting the needs of Langley research 
and professional personnel. Areas of the program which need' improvanent will 
fa^ ^<^^ nt^f and ways in whidi the program can be made more effective will be 
F^comerided. This task involves (1) determining throiigh open-ended queations ' 
during, in-depth interviews the areas and dimensions of the program which^ 
researchers consider important, (2) , constructing a closed-ended survey to be 
aistributed t6 all research personnel, (3) tabulating and analyzing the 
responses to the cdoeed-ended questions arid compiling and analyzing the piio- 
posed changes aad reccanmendations solicited by several open-ended questions 
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(4) presenting the findings of the questionnaire in a final report. The 
reeiiltf^.pf the survey will provide' m assessment of the adequacy of the NASA 
ZiangXey dn progran in meeting the needs of Langley engineers and scienei;8ts/^ 
bo^ at information producers and as information users. 

^ ftaitm lit Audit of Publication Process ^ 

"'^hasi 11 of the review and. evaluations project required an "audit" or 
manageiient anilynis of the policies, procedures, and practices us^ by the 
Hangley Reiearch Centier to process, publish, or otherwise Handle scientific 
and technical information. This task irtvolves (1) identifying the various 
media use^ by the Center tq!^ output its scientific and technical infbrmation; 

(2) compiliiysr all regulati(xis, policies, and instructions applicable to these 
medlar (3) documenting the procedure^ as currently prescribed; (4) comparing 
current or actual practices with published management: instructions to identify 
discrepancies or gaps in procedural guidance; and (5) reccnmending additional 
or modified j^rooedures. The results of the analysis will establish the total 
current procedural framework for processing, publishing, or otherwise handling 
Langley* 8 scientific information and to supplement existing practices and 
procedures to create a comprehensive, effective, undi^rstandable, and practical 
framework covering the handling of ^1 rjssearch output. 

^ ' \ 

Phase III:^ Audit of the Report and Manuscript Control Office (RAMOO) 

Phase III of the review and evaluation project requ^ires an audit or 
management analysis of the ^policies, procedures, andWactices used by RAMCO 
^Report and Manuscript Contrbl Office) to manage and 'report the Center's ^ 
scientific and technical informatioi^ output. _ 

The audit involves (1) documenting the current manual system using flow- 
charts, tables, and other systems analysis tools ^d techniqdes; (2) determining 
whether changes to the current Ananual system are necessary and justifiable; 

(3) proposing a neW manual or automated (internal or external) system wi^h 
appropriate justif icaticm for se^lection; (4) examining the feasibility of ^ 
in-*bou8e automation capabilitiesV.and' (5) presenting the procedural framework, 
underlying models, analysis, comments, and reocHnmendations in a final report. 




T|ie results of the analysis will provide an analysis and documentation 
of the current RAMCO operations, identi-fying areas for potential improvement 
including possible automation. Th^ audit will emphasize the records management 
aspect of the' operation. ^ 

♦ 

ifaase VTt Knowledge and Attitudes Stirv^j^ Academic and Industrial Personnel 

Phase IV of the review and evaluation project requires an assessment of the 
benjsfitSr usage, anl3 perceived quality^^of the NASAAian^ley STI Program and STI 
output^ by recipients/users in industry, government, and academia. Since the ' 
Langley SXI^ program is an. integral part of the Agency's STI program, NASA . 
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Headqpaarters has requested that the survey used by the cx^nsulting firm include 
questions peirtaining to the Agency-wide STI program and output. 

This task involves (1 ) preliminar^^^lephone interviewing of NASA STI users 
to sui^ly both content and direction for a closed-ended questionnaire, (2) con- 
structing a cloeed-ended questionnaire to determine the extent to which the pro- 
gran is mec^ting the needs of industrial and academic users of NASA/Langley STI, 
(3) tabulating and analyzing the responses to the questionnaire, and (4) pre- 
>senting the findings ^^of the questionnaire in a. final report. The results of 
the purvey will d^tei^mlne the knowledge of an attitude toward HASA and Langley 
STI held by the external user population. The results of Phase IV will be 
conbiAitd with the results of the other phases of the project to evaluate the 
Langley STI program. . ' 



Phase V: Bibliography \ 

Phase V of the review and evaluation project requires the development 
. of a selected, annotated biblio«aphy of literature citations on the topic 
of the. design and evaluation of/aTscientif ic,and technical information system. * 
The. results of Phase V will provide a theore'tical understanding and base upon 
which the methodology of the, review and evaluation project jwas founded. 

Phase VI 8 The NASA Formal Repoct ' ' 

—I ■ . • V- 

...^^^^^ Part I s The ScientificAechnipal Report — A Review ;Of Its 

Ccmponents and Current Usage , 

• \ ' 

Part I of Phase VI requires a comprehensive evaluation of the effective- 
ness of the scientific/technical report in transmitting STI. This task involves 
(1) developing criteria for the structure and use of the various report com- 
ponents, (2) documenting 4:he organization and sequence of the various components 
within a representative sample of reports, and (3) comparing the NASA formal 
reports, to, the report environment of today. The outcome or stated purpose of 
this evaluation will be the establishment of benchmarks by Which the NASA report 
can be evaluated. ^ 



A Part li s Quantitative and Qualitative -Criteria for ^valuation 

(BibliogtaE^y, Index, ^d Tables) 

Part II of the review and evaluation project requires ^ theoretical and 
analytical review of the formal report as a medium for information transmittal. 

This task includes (1 ) obtaining, through a manual and computer search, an 
e;diaustive bibliography of literature and (2) describing in quantitative terms 
the usage of report components in the report environment. The bibliography will 
contain (1) an index of reports pr^uced by government, oplleges, and private 
nterprise (acquired during prior research); (2) literature which describes the 
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usage of components in the scifentif ic/technical report; and (3) literature which 
pertains to the evaluation of fthese communications elements ^in the scientific 
report. : ' 

The outccme bf the review ptcj^c^ss will be the development of criteria for 
efficient report orMnization;. 

Partllli The NASA Formal Report — A Review, Assessment, 



and Recommendlartions 

, \ ' >; 

Part III df, the review and evaluation project requires an assessment of the 
overall refwrt drganization, the component parts of th^ report, and t^e rela- 
tionship of those parts within the total report context. This task includes 
(1) contrasting other industry and agency reports (illustrated in prior resfearch) 
with the NASA report, (2) determining which evaluative criteria can be applied to 
the formal evaluati^i? and possjlble modification of the NASA Langley technical 
report format; (3) es^t^ablishfng a methodology for evaluating the NASA report 
format, (4) outlining la sequence for the exponent parts and spelling out what 
each should include, andi^ (5> preparing and presenting a final report. 

' * ^ \ - ' ^ 

The dutCGoae of this ^i^ase will be a^suggested outline for a sequence and 
hierarchy of pirts;for specific users and a' series of criteria for graphic and 
verbal elemeiits. if . 



: " ■ r 
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Phade I - Knowledge and Attitudes Surveyr Langley Research Personnel 
Phase ir ,7 Audit of Publicatim Processes 

Phase III Audit* of the RepogL and Manuscript Control Office (RAMOO) 
Phase IV - Knowledge and Att]^^®^ Survey, Academic and Industrial 

Personnel ' 
Phase V - Annotated Bibliography 
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Headquarters 

Obligated for: 

Phase VI ~ The NASA Formal Report 

rbportSsig 



bhase of the' review and evaluation pliojeo^ will be documented^ 
results of the internal and external surveys wi published as NASA Quick^ 
Itelease Technical Memorandums. The selected, a|ifibtaj|!;ed bibliogra|^y on the 
^slgn and evaluaticHi of ^STI ^systems will i)e- published as a NASA Quick*Reledse 
Teclmlcal Moiorandun. A report to management will be prepared for. each phase 
"of the revim and evaluation project. The results of^ the review and eval^uation 
project Willi be documented in a sunnary re|>ort. 
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APPENDIX B 
SURVEY INSTRUMENT 



0MB No. 270a0029 



^ NASA Scientific and Tadinical Information System 

z 1 

2 USE OF SCALE: M«rk your opinion with a check (s/). 



importantl . 0 CH D CH EH unimporunv 



2 Scitntific rtMarch U 

g Chtek1fbr'*»tryimporunt!* | - Chack 4 for "somtwhat unimportant" 

5 Ch«ck2for"$om«whatlmporunt" 1 Chack 5 for "very unimportant" 

g ClMC^ 3 f or "nahhar imporunt nor unimporta|)t" 




questions are designed to determine fariiiliarity with and use of selected NASA STI publications and services 
Does your institution or organization subscribe to or receive NASA technical reports? 

don't know 



. yes 



- 2 



ioe$ your institution or organization subscribe to or receive such NASA announcement medta and abstracting 
Scientific and Technical Aerospace Report* (STAR) and International Aerospace Abstracts OAA)' 
STAR yes , 1 no don't know 



tools as 



lAA 



. yes 



don't know 



unimportant 



Unfamiliar with 



, For n^y r««arch, NASA technical reports are ordered: 

- frequently ,. □ Q □ □ tl 
X ' NASA technfcaf reports, when ordered, arrived 




3. For my research; NASA scientific and technilpal information is 
~ ' important^- L] D D D D 

4* For my research, I use: (check appropriate bobces) 

' * AiVay* 

— . •••STAR (Scientific and 
Technical Aerospace Reports), 
the NASA ^announcement 
journal for report literature 

b. lAA (lnternationarAer6space 
Abstract), the NASA 
' announcement 'journal for 
periodicals, meeting papers/ 
and conference proceedings 

SCAN (Sefected Current 
^A^ra^ce- Notices), a NASA 
^iriiftrwaranasl^juW^^ 

"NAsA literature searches 
obtained through^ the NASA 
Sciffhtifiq and ^Technical 
Information Facinty, NASA 
libraries; Defense Technical 
information Center, pf 
Department of Ener^ 

NASA SP-7037 ''Aleronautical 

Engineering Continuing • — • , — , x , — , , , 

BiWiography" /- ■ - ' □ \ C □ 

5L In terms of "advaociog the state-of-the-art", NASA scientific and techn^ca^k^f ormation is 



unimportant 



infrequently 



~ ^quiclcly 



□ □ □ □ □ 

slowly 



. do not arrive 



_ not applicable 
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iThtM questions are dtsigned to determine use of published scientific and technical information. 
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tte of Scientific and Technical Information 



13. 



Do you use non-NASA published literature in your research? 

•J" technical report literature yes 

journat articles ' : yes 



^ conference/mteting papers 



yes 



. no 
. no 
.no 



16 , 



Do youVse NASA authored published literature in your research? 
a, technical report literature yes 



b.' journal articles 

c conference/meeting papers 



yes 
yes 



. no 
. no 
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10. Do you use literature^blished by the Langley Research Center in your research? 

' a. technical report literature yes no 

b. i ournal articles yes no 

c' conference/meeting papers yes no 



not*sure 

not sure 
not sure 



. not sure 
. not sure 



J not sure 



Pirceivad Image of Langtey Authored Scientific and Technical Information . 

These questions- are designed to determine the perceived image (value) of Langley-authored (published) scientific and 
technical information. 



. ll.Whtn compared to other journal 
articles, m my discipline, the 
PRESTIGE of Langlty-authofed 
{ournal articles is 

92/Wh^l^mpared to other technical 
... i< repoirt literature in- my discipline, 
the PRESTIGE of Langley- 

authored technical reports is * 

/ 

13. Whtn. compared to other technical - 
report literature in njy discipline, 
the ADEQUACY OF DATA in 
^ * ' Lanfllty^authored technical^reports 

. ^14. When compared to other' technical 
report Hterature, the 
ORGANIZATION (format) of 
Laneley-authorad technical reports 

- ' ~ - — -.^r , 

. 151 When compared to other technical 
- : ^report literature/ the , QUALITY 
/ 01^ VISUAL PRESEMTATLONS in 
^ Langley-authored technical reports 

, : {e.9.i graphics; photography, type 
\ style) IS 



16. In! terms, of "ADVANCING THE 

,^ . .STi^TE-OF^HE-ART'', Unflley- 

au^iorecf scientific and technical 
inforrti^tion is 



higher 



higher 
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higher 



moYe 
readable 



□ □ □ □ □ 



lower 



lower 



. not familiar with 
^those from Langley 



. not familiar with 
thpse from Langley 



lower 



less . ^ 
readable 



not familiar vytth 
those from Langley 



not familiar with 
those'from Langley 



higher 



fmi^ortant 



□ □ □ □ □ 



lower 



□ □ 



I i ^ n unimportant 

■52 ' ' ■ 



not familiar with 
those from Langley 



, not familiar 
with those j. 
from Langley 
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9iCkground ' 

V Th« purpose of these questions is to determine whether people with different backgrounds atf have different opmiohs. The 
amwtffls will NOT be used to^ to identify anyone. 



17. Years of professional wqck experience (check one only) 

J. less than one /ear 1-5 year? 



-.15 years 



29 



/ 



/ 

It. Type of organization (check one o^fy) 
industrial organization 

c 

not'for'profit organization 

Other (please specify)* 



16-20 years 



e-lJOyears 
21 + Vears 



. educational institution 
government agency- 



19; Present professional duties (check one onlyj 

basic research 

^ teaching/academic (may include re^arch) 

private consultant \ 




applied research 
technical administration^ 
other (please specify) 



ZO^Xmajor field of interest 

Aeronautics' 

' Engineering 
Math and Computer Sciences 



Astronautics 
. Geosciences 
Physics, 



, Chemistry and Materials 
, Life Sciences 
, Space Sciences 



21. In terms of ffiy professional advancement/development, publishingis 

3* ' important Q ^ []_] [3] O unimportant , 

22. '()egardiq||publication, my management is 

"aaT supportive [3 D " D ' CZ] tZ] unsupportive 

23. Through which publication media do yo^ publish? (Indicate by numeric sequence, 1 indicating most frequently used.) 
"u*- ■ do not publish journal articles , 

technical reports ' conference/meeting papers « 

' computer programs other (please specify) \, 

J 24. How many technical/professional conferences (e.g.. workshiops, symposia, meetings) other than NASA conferences have 

35 you attended Mthirr the. last three,years/ * * 

25. How many NASA technical/professional conferences (e.g., workshops, symposia, meetings) have you attended within 

3^ • the last three years? ^ , ^ : ^ 

^ GfouD number 

(Thi» IS not us«d \p' 

* Idtnttfy you Ptrson«My.) 
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PROGRAM IMPROVEMENT (Please fill this out last) 
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1. Are there t:omments you would like to ^dd about topics covered in this questionnaire? 



1. 



V 



2. Are there comments you would like to add about anything hot previously mentioned^ 




3. ^ What can be done ^o make Langley-generated research more accessible to you? ^ 



/ 



V 
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December, i980 



\ 




4500 Colley Avenue 
Nqrfom.Vo 23506 



Thank you for your willingness to parflcipate in the survey* - 
phase of this study being done for Langiey Research Center. . 
This is one^phase of a project to review and evaluate the ' 
scientific and technical information program. , , , 

Your opinions aire vitalXf lease conq)lete the enclosed anonymous 
survey today and /return it to me at Continental Research, P. 0. 
Box 6112, Norfolk, Virginia 23508, using the pre-paid envelope * 
provided. ' >• , . ^ 

-Your cooperation is appreciated. ' 

Sincerely, ' * * >^ 

Nancl A. Glassman 
President 



^is ^ 
Enclosures! 



r p^e-test survey 
1 pre-paid envelope 
I post catd * 



Atari«ting, Advertsing. Politico!, ond Sociol Pfoblems Reseprch 
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ContlhentQl Research 



4500 Colley Avenue 
Nocfoik, Vo 23508 
, (604)469-4667 



December 16 > 1980 



Just a note to tHank you for your wllllagness to participate 
in^our survey for Langley Research Center. 

Someone from my- office tried to callAou last week to be certain 
that the survey had 'arrived and to tfhank yoo for yjpur help. Since 
you were unayailable, I just wanted ^o be sure^ you know how much 
your effort was appreciated. 

Thanks so much! 



Nanci A. Classman 
President 




/ 



AAofkefing, Advertising, PoHricol, ond Sociol Problems Reseorch^ . 
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QUESTIONNAIRE WITH AGGREGATE TALLIES 



i 

! 

8 
I 

m 

s 



NASA Scicntinc and T«chn(cai Information System 
USi OF tCAU; MMfc ywir ii^Moff wftH I c»M^ 

Iwporttm 0 D D D D Mwimpofunt 



ALL FIGURES AU PERCEKTAGES THAT TOTAL lOOZ 
SAMPLE SIZE - 381 



CkMk t f0f *yt9i^^ im^oftsfitt* ' ^ 
0imk%im''*Mm iwyo rm it nor uotmponm 



Chtck 4 for "tomtwtiat utiimporunt" 
Chtck 5 for '^rtrv unimporunt" 



Thttt qu«$tion$ art dtsifntd to dtttrmint familiirity with ind utt of Mitcted NASA STkpublicition$ and services 
Dots yo(jr institution or organization su,bscribe to or recttva NASA technical reports? 
_Wi5_ves 5*5 W 11.5 



no^ 



don't know 



Z Does your institution or organisation subscribe topr receive such NASA announcements media and abstracting tools as 
Scttntific and Technical Aerospace Reports^'lSf AR) and tnternational Aerospace Abstracts (lAA)? 
STAR 604 ^4 ^ 12.1 27.6 



44.1 



.yes 



15.5 



40.4 



For my research, NASA scientific and technical information is ^ 

imporunt IILn 

4 ZH76 1577 5T5 377 



. don't icnow 
. dbn.'t^tcnow 

unlrn portent 



4, f <^ my rtstarch. [ use; (check appropriate boxes) 

• STAR (Scientific and 

Technical Aerospace Reports), 

tht NASA announcement 
' jourhar for report literature 

lAA (International Aerospace 
Abstract), the >»JASA 
announcement journal for 
periodicals, matting {papers,. 
^ and confererice proceedings 

c §^CAN (Seltcjfd^rrent 
AtfoHMCt Notices), a' NASA 
currtint awarfntu publication^ 

NASA^iterature searches 
obtained through the NASA 
Sci^tific and Technical 
Information facility; NASA 
libri^ies. Defense Technical 
information 'Centeh or 
^ Oapartment of Energy 

-y- t. NASA SP-7037 "Aeronautical 
' Ertginetrir^g Continutng 
Biblibgraphy". 



N/A 
3.9 



(No answer) 



UiMtly S«mtllm«« N«vtr ^ Ufif«fhlltjr wiltw 



26.8 

□ 



11.5 


ia.6 


35.2 


7.9 


□ 


□ 


□ 


□ 


5.0 


10.0 


32.8 . 


10.5 








□ 


4.5 , 


8.4 


18.6 


14.7 


□ , 


□ 


: □ 


□ 


6.0 


11.0 * 


r 

34.9 ' 


18.9 


- □ 


□ 


□ 


• □ 


U6 


4.2 , 


10.8 


19.9 



5. lnterm$of "advancing.thestate-ofthe-art 

~ impomht- O D'tl □ □ 

1. Pormy rmlrehf M/^i^n4irr^pom' ire o^r^fi 

J- fr^^ntly " □ □ □ □ □ 
, ,16*0^5.2 25.2 10.0 10.5 

7. NASA ttchnicir rtportt, whtn ordtrtd, arrive: 

quickly □ Q 

9.2 25.^2 31.2 7.1 5.0 



NASA scientific and technical information is 



41.7 
53.8 

□ 



29.1 

-P 

63.5 

□ 



unim(5ortant 
infrequently 



N/A - 
4.2 



(na answer) 



13.1 not ordered 



tlowly QtP do not arrive 22.3 • not applicable 
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tki of Sdantific and Ttchnicit tnf orm«tion 

TbMt qutitions art dtsignKl to dturmint um of pubtithtd scitntif ic and ttchnical information. 



H Oo you ust non-NMA publMitfl littratura in your restarch? 



I) 

vn- 



ttchntcal rtport tittraturt 



\2h 



yts 



ilioo 
Jlinp 



joumaUrticlts yes 
^ conf trtoct/mtating paptrt 96il yes 2t4, no 

Oo you uft NASA MithortdVubiithed literature in your research? 
«. . ttchnicat rtpbft literature > 



2.4 • N/A 
1.3 • N/A 
1.6 • N/A 



(no ansvet) 



\ 

b, . journat articles 
, c confertnc^/meeting' 



ngVei 



iperi 



86.1 


yes 


8>4 


no 


84*8 


yes 


.9.4 


no 


85.8 


yes * 




no 



ia Oo you use literature published by the Un9ley Research Center in your research? 
«. technical rtport literature ^ - 
b, journal articles 
c 9onference /meeting papers 



75.1 


yes 


13.1 


no 


71.9 


13.1 

12^3 


no 




yes 


no 




Ptrcaived Ima9e of Langley Authorad Scientific and Technical Information 

These questioru are designed to determine the perceived image (value) of Lengley-autho^^d ^published) scientific and 
technical infonnation. \ / 



11. When compered to other journal 
^ articles in my discipline* the 

PRESTIGE of Langleyau^ed 
journal articles is 

12. When compared to other technical 
_ report literature in my discipline, 
*^ the PRESTIGE of Langley* 

authored technical reports is 

13. When conopered to other technical^ 
report literature in my disci ptine« 
tha ADEOUAdY OF DATA in 
Langley-authored technical reporu 



14. When compared to other technicaf 
report I iter a tu re / the 

ORGANIZATION (format) of 
tangley^authored technical reports 
«* 

15. When comi^red to other technical 
— report literature, the QUALITY 

Of VISUAL PRESENTATIONS in ' 
Lanfley-authored technical fpom 
(e.g., graphics, photography, 'type 
ttyte) is 

IC In "terms of "ADVANCING THE 
j_ STATE-OF-THE-ART", Ungley- 
authored scientific and technical 
Information Is 



higher 



higher 




1.7 3.9 ^ 1.0 




□ □ 



11.0 30/4 36.0 4.2 

□ n □ □ 



ll3.4 34.1 32.5 1.3 

□ □ □ □ 



more 
readable 



higher 



13.6 33.9 32.3 

□ □ □ 



16.5 33.1 2SU1 

□ □ □ 



2.4 

□ 



3.1 

□ 



22.8 32.5 26.8 

impprtant □ □ □ 



2.6 

□ 



□ 



0.8 

□ 



0.3 

□ 



0.3 

□ 



0.5 

□ 



1.0 

□ 



lower 



lower 



^not familiar >^ith 
hose from Langley 



. not 
those fro< 



lower 



less 

readable 



lower 




not familiar with 
those from Langley 



not familiar with' 
^those from Langley 



, not familiar with 
those from Langley 



unimportant 



14.2 



not familiar 
with those 
from Langley 



52 



'58 



/ 
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kground 

KM ofthtM qut$tjon$ is to dittrmine ¥»/hethef people with different backgrounds all have different opinions The 
I will NOT bt ustd to try to identify anyone. 



t7. YearVof professional work experierKe (check one ot^y) 

— 0»Q 2 9 

aa one year 1-5 years 



22.0 



-15 years 



It. Type of OTQanizati^n (check one only) 
67.2 

. industnaXprganization 
3i7 not-for*prof\proanization 
other (please specify) 



2^*3 16-20 years 

28.1 



- 6-10 years 
^5.7 21+ years 



0.3 • N/A 



educational institution 
LlQ. government agency 



19. Present professional duties (ched^one only) 

^0 •* 51.7 basic research/allied research 

23.4^ teaching/academic (teay include research) 
34*7 private consultant /technical administration 

20. Major field of interest 



0.3 - N/A 



\ 

39.9 Aeronautics/Astronaut i9s . 
7«1 Chemistry & Materials /l^hysics^ 
12.1 Math and Computer Science 



8.4 Geosciences/Life Sciences /Space Sciences 
31.5 Engineering (where that was the only 



item checked) 



^ . . , . \1'0 N/A 

21. \t\ terms of my professional advancement/development, publish irtg is 



importan, □ □ □ □ □ 
ZL Regarding publication, my r^na^n?ent ?s 



unimportant 



N/A 



« - -p-"- ^ & Q2 ""'"^'^t 0.3 

21 Through which publication media do you publish? (Indicate by numeric sequ^ce. 1 indicating rtost frequently used ) 
"ST . 7.1 - do not publish V \ 

91.6 T do publish Y \ ^ 

- N/A ^ 

aC . How many technical/professional conferences (e.g., workshops, syimposia, meetmgi) other than NASA conferences have 
^ ^» you attended within theJast three years? 4.2- no ne 64.3 - one to* eight ^ 31.5 - 9 more 

\^25. How many NASA tedinical/professional conferences (e.g.. workshpps, symposia, meetings) have you attended vv.th.n 
^ the last three veir«7 . - " 



\ 



the last three years?^^ 

..20.5 - none 
23.6 rr one 
24.9 - two 
\15.3 three 
\3'.9 - four 
3.9 - five ' 
3.4 - six 
l.d • seven 
0.3 V «ight 
- 3*1 A\|iine or more 
\\ 



.COAST 

44. 4<- Eastern 
21.8 - Central 

4.5 - Hotxntain 
29.4 - Pacific 



— Group numt>«i 

k <Tnii li not uMd to 

\ . » id«nt«iy you Mnon^uy > <v 

^From initial Phone CallNr tio you ^ 
t^se NASA or LaRC published 
information in your work?r 

3.4 - used neither 
17*6 - used KASA only 

2.1 - used Langley only 
74.0 - used both 

2.^ -N/A 



\ 



\ 



53 



.59 



■ \ 
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iBPPENDIX F ■ 

QUESTIONNAIRE WITH AGGREGATE TALLIES WITHOUT ''DON'T KNOW" RESPONSES 



NASA Scitntific and Ttchrtical ^formation Syittm 



ALL DECIMAL FIGURES ARE PERCEKTAG^S 

- , r ALL WHOLE NUMBERS ARE # of people " 

mi OF tCAtg? Miffc Yoar t»<w<pn ditcfc (V). j ^. SAMP.LE SIZE - 381 

OMMfk 1 f«f 'Vtry^impofttnt'' . Cli«ek 4^ '"lomtwhat unimportant" 

ONdt 2 for 'lMmt«4itt important*' ^ CNcfc 9 fOr 'Vtry unimi^ortant" 

Cfcac fc > for **withtT hnpo ^tan t nor unimportant** 

T^hoM qutttiom ara datigntd to dtte^mtna faminarity with and us^ of taiected f^ASA STl publications and services 
Ooat your institution'or organization subscribe to or rocaiva NASA technical reports? 

Vts 3,5 „o ^ 11.5 

Z 



don't know 



OoM your institution or organization subscribe to. or receive such NASA announcement media and abstractmg tools as 
Sdentific tnd Tadmical Aerospace Reports (STAR) aod InternationafAerospace AbstrKts (lAA)? 
60.4 _ • 12.1, _ 27.6 



STAR 
lAA 



44.1 



. yts 
.yts 



15v5 



no 

, no 



40.4 



For my research, NASA scientific an^ technical infoTmation is 

e: (chack aooroonate boxesl ^ ^ 



. don't know 
. don't kno^ 



For my research, I use: (check appropriate boxes) 



a. STAR (Scientific and 
Technical Aerospace Reports), 
the NASA announcement 
Journal for report literature 

b. lAA (International Aerospace 
Abstract), the NASA 
announcement journal for 

- periodicals, meeting papers, 
and conference proceedings 

c SCAN. (Selected^ Current 
Aerospace Notices), a f^PSA 
current awareness publication 

d. NASA literature searches^ 
obu'tned through tf^ NASA 
Scientific and Technical 
Information Facility. NASA 
libraries, Dafens^ Technical 
Information Center, or 
Department of Energy 

t. NASA Sfr.7037^'Aeronautical ' 
' Eng^intering Continuing 
BiWiof^aphy" , « 





U«i«lly Samttimw 

Percentages 


M«vtr 


' 15,8 / 


I25.4 . 


48.0 


10.8 


% □ 


□ ■ 


□ 


□ 


8.6 


,17.1 


56.3 


18.0 




□ 


■ □ 


□ 


9.7 ' 


18.2 . 


40.3 


31.8 


£. 




□ 


□ 


8?$ 


c 

15.6 


49.3 


26.7 


□ 


•□ ' 


□ 


□ 


4.3 


11.5*' 


29.5 


54*7 


•'□ * 




E. 


□ 



unimporunt 15 people N/A 



102 people 
159 people 

□ . 

205 people 

■□ 



.10 



In terms of "advancing the ttate-of-the'art","NASA scientific and technical information is 

unimporunt 

^44.9 38.6.11.8 2.7 T.9 



111 people 

a 

242 people 

□ 



12 



For my technical reports are ordered 

NASA tichnicii reports, when ordered, arrive: 

oulckly, □ □ □ □ □ 
11.8 32.4 40.2 9.1 6.4 



16 people M/A 



infrequently 

slowly* _2 

54 



50 people 



not ordered 



. dolnot arrive ^L£^!?n<S applicable 



APPENDIX F 

Dm of Seitntifie and Ttchnical Information ^ 

Thm qutttions art dtsigntd to dtttrmint utt of pubtishtd icienlific and technical information 

.t. Oo you ustnpfvNASApublitlUdllttraturf in your research' ^ ' 
«. ttchntcat rtport littraturt 97*6 y^, 

^ jouri^ articles 98, 1 yes 

.c. oonfertnct/mteting papers 



0MB No. 2700-0029 



no 

■J.t9 no 



97.fi yes/* JLA-rw 

' Oo you use NASA authored puWtthed literature in your research? ' 

91.1 



9 people N/A 

5 people N/A 

6 people K/A 



ttchnlcat report literature 
journal articles 
conference/meeting papers 



90.0 
91.6 



f 
yes 

yes 



^*9 nn 
10.0 



8.4 



no 
no 



21 peo ple not sure 

22 people^ ^^^^ 
24 peo£le_ 



Do you use literature published by the Uhgley RtMtroh Center in your research? 



technical repon literature 
journal articles 
conference/meeting papers 



85.1 
84.6 
85.8 



yes 
yes 



14.9 
15.4 
14.2 



. no 
no 



no 



45 people 



rnot sure 



57 peogOe^no^jy,^ 
51 peo ple nAt KUTP 



Pircaivad Image of Langley Authorad Scientific and Technical Information 

These questions are designed to determine the perceived image (value) of Ungley- authored (published) scientific and 
technical fnfonnation. ^ 



11. When compared to other joumet 
Tjj- aytjcles in, my discipline, the 

PRESTIGE pf Langley authored 
. journal articlW is 

12. When compared to pther techniul 
— report literature in my discipline. 

the PRESTIGf of Langley 
autfiorjMl technical reports is 



24 



13^ When compared to other technical 
T report literature in my discipline, 
thi ADEQUACY OF DATA [n 
.Laneiey^^authored technical reports 

IS ' 



. 14. Whfn comi)ared to other technical 
— . report literature, the 
" -.ORGANIZATION (format) of 
Langlty-authored techntcaf repbru 

, is ^ 

IS. When compare^ to other technical 
-35- report lltwature, the QUALITY 
Of VISUAL- PRESENTATIONS in 
Lanalay'MrttMfed technical reports 
U.f„ graphics, photography, type 
style) is 



27 



ICIn farms of ^ADVANCING THE 
. STATE-OF-THE-ART". Langley' 

authored scientific and technical 

information is 



higher 



higher 



11.2 31.7 51.0 4.8 1.3 

□ r~i n n r^' peo?ie 
I — I. I — I I— I I — I lower not familiar with 

those from Langley 



higher 



more 
readable 



13.^ 36.9^^43.6 .5.1 1.0 

□ □ S □ □ 



16.4 41.8,39.9 1.6 0.3 
□ □ □ □ □ 



16.6 41.1 39.2 2.9 0.3 



, people . 

lower - 1. not familiar with 

^ those from Langley 



lower 



lie 



not familiar with 
those from Langley 



□ rn r-n i—i r-i lessP^^Mfi^ not familiar with 
LJ I i I I I I readable those from Langley 



20.1 40.1 35.4 -3.8 0.6 67 ' 

higher C [Zl IZ] [Zl [Zl lower^^l!^ not familiar with 
«> \^ those from Langley 

26.6 37.9 31.2 3.1 1.2 ^ 54 

Important Q D [H unimportan^5££i? not familiar 

with those 
from Langley 



55 



61 
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Biclcfrotifid 

TTw purpM 9/IJIm% qimtions it to dtttrmint v^ttKtr ptopit with different backgrounds «ll have different opinions The 
intmm tMH ^'^'^ ^ identify enyorte. 

17. Yftre of i»mfMiional work exptrienctichtcfc one only) 

r -0*0 Itis thtn one year t-S years 

11-1S years ^^^^ 1§-20year$ 



7*9 6-10 years 



45.8 



21+ years 



1 person M/A 



li. TyptMoTfaniution (check one only) 
it* « .fiZAiL. induitrial or9inization 

not*for>profit organization 
other <plaa»tpfcity) 



28.1 educational institution 



1.0 



government agenpy 



111 fraiant professional duties (check or>t only) 
io" 31>8 basic research /\*PPli«d research 



1 person K/A 



taaching/academic'(may include research) 

2^.7 



private consulttnt/tech. administration 
90. field of interest ^ ^ 

iT 40* 3 Aeronautics /Astronaut ics 



8.5 Geo8c;Lences/Li£e Sciencet»/Space Sciences 

31.8 Engineering (where that ^was the only 
item checked) ^ 

4' people K/A 

21. in ter^ns of my professional advancement/developmant, pubttshing is 



7*2 Chemistry & Katerials/Physics 
12*1 Hath & Computer Science 



22. Hagarding publication, my management is 

iaT 



unimportant , 



•wpPfe^* ' D ED D D CU unsupportive 

45.3 29.2 18.9 5.3 1.3 , . 

Through which publication madia do you publish? (Indicate by numeric sequence, 1 indicating most ffequently used ) 



7-2 not publish ^2. 8 do publisli 



1 person M/A 

, 1 indicatir 
5 people M/A 



2L How many tachnical/profeuional conferences (e.g.. workshops, symposia, meetings] other than NASA conferences have 
vcua«andedwithinthelastthrefyears? ^*2 - non e 64.5 - bne to eight 31.5 - 9 or more 



jtk How many NASA technical/professional conferences (e.g.. workshops, symposia, mtetingi) have you attended withm 
thtlaitt 



- 

23*6 * 
?4*9 - 
15.3- 
3.9 - 



yaars?_ 
none 
one 

ttfO 

thrae 

fojir 



3.9 - five 
3.4 - six 
1.0 * savan 
0.3 -liight 
3*1 - tiina or 
mora 



COAST 



44.4 
21.8 
4.5 
29.4 



«- Eastern 

- Central 

- Mountain 

- Pacific 



- Ill ■■■ Q''0"P numt>ei 
(Thu u not uwa to 
M«ntiry you ptrionjliy } 

(From initial Phone Call - 
Do you use NASA or LaRC 
published info/ itJ your work?) 

3«5 - tised neither 

18.1 ^ used NASA only 
2.2 - used Ungley only 

76.2 - used both 
11 people - M/A 



56 



62 



